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1.  INTRODUCTION 


A  natural  formulation  for  many  statistical  problems  Is  one  combining  Bayesian, 
sequential  and  decision-theoretic  aspects.  For  the  problem  of  deciding  the  sign 
of  a  normal  mean,  Chernoff  (1961,  1965a,  1965b),  Breakwell  &  Chernoff  (1964)  and 
Bather  (1962)  develop  an  approach  to  such  a  formulation  where  sums  of  successive 
observations  are  replaced  by  a  continuous  time  Wiener  process.  Subsequently, 
this  approach  has  been  employed  by  Chernoff  &  Ray  (1965),  Chernoff  (1967),  Bather 
&  Chernoff  (1967a,  1967b),  Feder  &  Stroud  (1971),  Petkau  (1978),  and  Chernoff  & 
Petkau  (1981)  In  a  wide  variety  of  problems. 

The  continuous  time  problem  has  a  number  of  fundamental  advantages  over  the 
discrete  time  problem  for  which  it  Is  an  approximation.  First,  the  continuous 
time  problem  can  be  normalized  so  that  many  of  the  parameters  which  appear  in 
the  original  (discrete  time)  problem  are  eliminated;  thus,  a  single  continuous 
time  problem  corresponds  to  an  entire  class  of  discrete  time  problems.  Second, 
the  continous  time  problem  Is  equivalent  to  an  optimal  stopping  problem  for  a 
Wiener  process  where. the  cost  associated  with  stopping  depends  only  on  the 
stopping  point;  any  such  problem  Is  related  to  a  problem  In  analysis,  a  free 
boundary  problem  (FBP)  involving  the  heat  equation.  This  relationship 
facilitates  obtaining  bounds  and  asymptotic  approximations  for  the  solution 
of  the  continuous  time  problem. 

While  these  bounds  and  asymptotic  approximations  provide  valuable  Insight, 
in  most  problems  they  do  not  provide  an  adequate  approximation  to  the  solution. 
Techniques  are  required  which  will  provide  numerical  descriptions  of  the  solution 
of  the  continuous  time  problem;  this  solution  will  then  provide  approximations 
to  the  solutions  of  an  entire  class  of  discrete  time  problems. 
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In  this  paper  we  will  describe  simple  numerical  techniques  which  can  be 
easily  employed  to  obtain  explicit  descriptions  of  .the  solutions  of  such 
continuous  time  problems.  The  basic  idea  is  straightforward:  the  Wiener  process 
is  approximated  by  a  discrete  time  process  and  backward  Induction  is  employed 
to  solve  the  optimal  stopping  problem  for  this  new  process.  The  techniques  will 
be  illustrated  in  a  number  of  problems  thereby  clearly  indicating  their 
properties.  Some  of  these  problems  have  and  some  have  not  been 
previously  investigated  in  the  literature. 

The  reader  may  feel  that  the  path  that  has  just  been  traced  is  somewhat 
circular.  We  begin  with  a  discrete  time  Bayes  sequential  decision  (optimal 
stopping)  problem  which  can  be  solved  by  backward  induction  and  approximate  it  by  a 
continuous  time  optimal  stopping  problem  for  a  Wiener  process  which  we  propose  to 
solve  by  applying  backward  induction  to  a  discrete  time  version  of  the  Wiener  process. 
However,  the  situation  is  not  quite  so  empty.  First,  as  already  Indicated,  the 
continuous  time  problem  allows  one  to  derive  valuable  characteristics  of  the 
solution  including  asymptotic  approximations.  Second,  there  are  available 
excellent  approximations  to  the  difference  between  the  solution  of  the  continuous 
time  problem  and  those  of  its  various  discrete  time  versions.  Thus,  we  can  solve 
the  optimal  stopping  problem  for  a  particular  discrete  time  version  and  use  the 
solution,  properly  adjusted,  to  approximate  that  of  the  continuous  time  problem. 

This  approximation  can  then  itself  be  adjusted  further  to  approximate  the  solution 
of  any  of  the  original  discrete  time  problems.  Thus,  the  single  backward 
induction  applied  to  the  discrete  time  version  of  the  Wiener  process  provides 
solutions  for  the  normalized  continuous  time  problem  and  all  of  its  discrete  time 
versions. 

In  this  paper  we  will  focus  on  obtaining  numerical  solutions  for  continuous 
time  problems.  The  question  of  whether  these  continuous  time  solutions,  when 
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properly  adjusted,  yield  accurate  approximations  to  the  solutions  of  the  original 
discrete  time  problems  must  be  considered  on  a  problem-by-problem  basis.  We 

3 

merely  mention  here  that  this  question  has  been  considered  in  detail  for  a 
problem  involving  Bernoulli  data  by  Petkau  (1978)  and  for  a  different  problem 
involving  normal  data  by  Chernoff  and  Petkau  (1981);  In  both  cases,  the  adjusted 
continuous  time  solutions  provided  accurate  approximations  to  the  solutions  of  the 
original  discrete  time  problems. 


2.  PROBLEMS  UNDER  INVESTIGATION 


The  techniques  to  be  described  can  be  applied  to  obtain  a  numerical 
description  of  the  solution  of  our  special  class  of  optimal  stopping 
problems  involving  zero  drift  Wiener  processes.  With  one  exception*  the 
normalized  forms  of  the  continuous  time  Bayes  sequential  decision 
problems  to  be  considered  In  this  paper  are  special  cases  of  the 
following  optimal  stopping  problem:  Given  a  Wiener  process  {Y(s):  s  ^  s^)  In  the 
-s  scale,  described  by  E(dY(s))  =  0  and  Var{dY(s))  «  -ds  and  starting  at 
YCsq)  =  Yq  (sq  >  s^),  find  a  stopping  time  S  to  minimize  the  risk,  £(d(Y(S) ,S) ); 
here  d(y,s)  Is  the  cost  associated  with  stopping  at  the  point  (y,s)  and  stopping 
Is  enforced  at  the  end  of  the  problem,  namely,  when  s  ®  s^. 

Some  characteristics  of  the  solution  of  such  an  optimal  stopping  problem 
can  now  be  described.  If  we  define  dCy^.s^)  =  Inf  where  t>(yQ,SQ)  is 

the  risk  associated  with  a  particular  stopping  time  (procedure)  and  the  Infimum 
is  taken  over  all  procedures,  then  since  Y(s)  Is  a  process  of  independent 
Increments,  d(y,s)  represents  the  best  that  can  be  achieved  once  (y,s)  has  been 
reached.  Irrespective  '  of  how  It  was  reached.  Thus,  the  rule  "Stop  as  soon  as 
d(Y(s),s)  =  d(Y{s),s),'*  which  yields  an  optimal  procedure  If  one  exists,  can  be 
described  by  the  continuation  set  C  »  ((y.s):  d{y,s)  <  d(y,s)}  or  by  Its  complement, 
the  stopping  set  $  -  =  ((ytS):  d(y,s)  =  d(y,s));  attention  can  therefore  be 

restricted  to  procedures  which  can  be  so  described.  Note  that  this  character¬ 
ization  does  not  depend  upon  the  initial  point  (Yq^Sq)  and  thus  yields  the 
solution  for  all  initial  points  simultaneously.  Chernoff  (1968,  1972)  has 
demonstrated  that  one  should  expect  the  solution  (d,C)  of  the  stopping  problem 
to  be  a  solution  of  the  following  free  boundary  problem  (EBP)  Involving  the  heat 
equation  (ac  denotes  the  boundary  of  the  set  C): 
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<yy(y.S)  •  djty.s) 

for  (y.s)  E  C  , 

d(y.s)  -  d(y.s) 

for  (y.s)  £  S  , 

dy(y,s)  -  dy(y,s) 

for  (y.s)  E  iC  5 

this  relationship  enables  one  to  obtain  bounds  and  asymptotic  approximations  for 
the  solution.  One  particular  result  Is  that  for  any  such  stopping  problem  one 
should  never  stop  at  points  (y.s)  where  H(y,s)  «  ^id^yCYtS)  -  d^(y.s)  <  0;  If  one 
thinks  of  the  optimal  stopping  problem  as  a  gantllng  problem,  then  H(y.s)  can  be 
heurlstically  thought  of  as  the  "rate  of  losing"  at  the  point  (y.s).  Further.  It 
Is  obvious  from  (2.1)  that  changing  the  stopping  cost  function  d(y.s)  by  adding 
to  It  any  solution  of  the  heat  equation  leaves  the  solution  ^  of  the  EBP  unchanged. 

Some  special  cases  of  this  general  optimal  stopping  problem  which  have 
already  been  Investigated  In  the  literature  are  now  described. 

Example  2.1.  Testing  for  the  sign  of  a  normal  mean,  Chernoff  (1961).  X^,  X2.  ... 

are  Independent  A/(u,a^)  random  variables  (o^  known).  It  Is  desired  to  test 

^  0  versus  H2:  u  <  0  ,  where  the  cost  of  a  wrong  decision  Is  klul  and  the 
cost  of  observing  n  X's  Is  cn.  If  the  parameter  p  Is  assumed  to  have  a  normal 
prior,  what  Is  the  Bayes  sequential  strategy?  A  normalized  form  of  the 
continuous  time  version  of  this  problem  Is  a  special  case  of  the  general 
stopping  problem  formulated  above  with 

(2.2)  d(y,s)  “  s’^  +  s'*  t(y/s'*)  for  s  >  0  j 


here 
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(2.3) 


t(x)  =  ♦(x)  -  x(l  -  ♦(x)) 
=  fC-x) 


for  X  ^  0  , 
for  X  <  0  , 


while  4  and  ♦  are  the  standard  normal  density  and  cumulative  respectively.  For 
further  detail,  the  reader  Is  referred  to  Chernoff  (1961.  1965a,  1965b,  1972), 
Breakwell  &  Chernoff  (1964)  and  Bather  (1962).  Closely  related  work  appears  in 
Lindley  (1961).  Moriguti  &  Robbins  (1962)  and  Lindley  &  Barnett  (1965).  We  will 
refer  to  this  problem  as  the  sequential  analysis  problem. 


Example  2.2.  One-armed  bandit  problem.  Chernoff  &  Ray  (1965).  X^,  X^  are 
independent  W{p.o^)  random  variables  (o^  known).  The  payoff  for  stopping  at  n  N 
is  X|  +  X^  +  +  X^,  When  p  has  a  normal  prior,  the  normalized  continuous  time 
version  leads  to  the  special  case 

(2.4)  d(y,s)  =  -y/s  for  s  >  1  . 


The  variation  where  X^  is  either  a  or  b  with  unknown  probabilities  p  and  1  -  p  and 
p  has  a  beta  prior  is  relevant  to  (a)  a  one-arnjed  bandit  problem  with  a  limited 
nunter  of  pulls  available,  (b)  the  rectified  sampling  inspection  problem  in  which 
context  this  problem  first  appeared,  and  (c)  clinical  trials  comparing  a  new 
treatment  against  a  known  one  with  a  finite  horizon  of  patients  to  be  treated, 

Chernoff  (1967).  For  discussion  of  the  continuous  time  version,  see  Chernoff 
(1967,1972). 

Example  2.3.  Sequential  medical  trials  involving  paired  data.  Anscorribe  (1963). 

There  is  a  horizon  of  N  patients  to  be  treated  with  one  of  two  available  treatments. 
In  the  initial  (experimental)  phase,  n  pairs  of  patients  are  treated  sequentially 
with  different  treatments  randomly  assigned  to^ the  patients  in  each  pair;  the 
remaining  N  -  2n  patients  are  all  assigned  to  the  treatment  which  is  inferred  to 
be  superior.  The  differences  in  the  values  of  the  outcomes  for  each  pair  are 
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independent  ^(p,o^)  random  variables  (o^  known)  and  the  cost  of  treating  any 
patient  with  the  inferior  treatment  is  proportional  to  |u|.  If  the  parameter 
u  is  assumed  to  have  a  normal  prior,  what  is  the  Bayes  sequential  strategy? 

The  continuous  time  version,  recently  studied  in  detail  by  Chernoff  &  Petkau 
(1981),  leads  to  the  special  case 

(2.5)  d(y,s)  =  -(1  -  1/s)  |y|  for  s  >  1  . 

Related  work  appears  in  Begg  &  Mehta  (1979),  Petkau  (1980),  Lai,  Levin. 

Robbins  &  Siegmund  (1980)  and  Lai,  Robbins  &  Siegmund  (1983).  We  will 
refer  to  this  problem  as  the  Anscombe  problem. 

Example  2.4.  Sequential  medical  trials  for  comparing  an  experimental  with,  a 
standard  treatment,  Petkau  (1978).  There  is  a  horizon  of  N  patients  to  be 
treated  with  either  the  standard  treatment,  characterized  by  a  known  probability 
of  success  Pq,  or  the  experimental  treatment,  characterized  by  an  unknown 
probability  of  success  p.  Sampling  is  to  be  initiated  with  the  experimental 
treatment  and  continued  with  this  treatment  during  an  experimental  period  until 
a  decision  is  made  in  favor  of  one  of  the  treatments;  the  remaining  patients 
are  then  treated  with  the  favored  treatment.  There  Is  a  cost  incurred  for  each 
unsuccessful  application  of  either  treatment  as  well  as  a  cost  of  experimentation 
which  is  incurred  for  each  patient  treated  during  the  experimental  period.  If 
a  beta  prior  is  assumed  for  the  parameter  p,  what  is  the  optimal  design?  A 
continuous  time  version  of  this  problem  leads  to  the  special  case  (here  y  is  a 
normalized  cost  of  experimentation  parameter) 


(2.6) 


d(y,s)  «  y/s  -  y 
==  y/s  "  y/s 


for  y  ^  0,  s  ^  1  , 
for  y  <  0,  s  ^  1  . 
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The  above  examples  arise  naturally  in  the  statistical  problems  described. 

In  each  case,  closed  form  solutions  are  unavailable;  complete  descriptions  of 
optimal  procedures  are  available  only  through  numerical  techniques  such  as  those 
to  be  described.  In  order,  to  fully  Illustrate  the  properties  of  these  numerical 
techniques,  a  problem  of  the  same  general  form  as  Examples  2,1  -  2.4  but  for 
which  the  solution  is  available  in  closed  form  will  be  useful.  The  following 
modification  of  Example  2.3  will  serve  our  purpose. 

Example  2.5.  Modified  Ans combe  problem.  This  artificial  problem  corresponds 
to  the  special  case 

<^(yts)  =  -(1  -  1/s)  (y|  “  2s*^(^(y(s)/s^)  for  s  ^  1  , 
where  y(s)  is  defined  by 

(2.8)  1  -  ♦(y{s)/s^)  =  s‘V2  . 


It  Is  easily  verified  (see,  for  example.  Chernoff,  1968.  1972)  that  the  optimal 
solution  (d,C)  for  this  problem  is  given  by 


(2.9) 


C  =  ((y.s):  |y|  <  y(s)  .  s  >  1}  . 
d  =  “|y|  *  2sS(y/s*^)  for  (y.s)  e  C. 


where  y  is  defined  in  (2.3);  of  course,  d  h  d  for  (y.s)  e  S  =  C^. 

The  statistical  problems  described  above  all  lead  to  special  cases  of  the 
general  optimal  stopping  problem  for  a  zero  drift  Wiener  process  in  the  (y.s) 
scale  which  was  described  in  the  first  paragraph  of  this  section.  While  these 
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statistical  problems  will  be  the  main  interest  in  this  paper»  the  techniques 
to  be  described  apply  equally  well  to  a  class  of  gambling  problems,  the  general 
case  of  which  can  be  described  as  follows:  Given  a  Wiener  process  {X(t):  t  <  t^l 
in  the  t  scale,  described  by  E(dX(t))  *  0  and  Var{dX(t))  =  dt  and  starting  at 
X(to)  ■=  Xq  (tQ  <  t^),  find  a  stopping  time  T  to  maximize  the  expected  reward 
^i9(X(T)»  T));  here  g(x,t)  is  the  reward  associated  with  stopping  at  the  point 

(x.t)  and  stopping  is  enforced  at  the  end  of  the  problem,  namely,  when  t  *  t^. 

The  solution  of  any  such  problem  will  not  depend  upon  the  initial  point 

(xo»to)  and  we  will  denote  the  optimal  reward  at  (x.t)  by  g(x,t).  For  a  detailed 

study  of  this  general  problem#  the  interested  reader  is  referred  to  Van  Moerbeke 
(1974a,  1974b,  1975)  and  Shiryaev  (1978).  Two  results  of  particular  interest 
are  that  the  solution  of  this  stopping  problem  can  be  represented  as  the 
solution  of  a  free  boundary  problem  for  the  backward  heat  equation, 

*jUxx  "  0,  and  that  one  should  never  stop  at  points  (x.t)  where  H(x,t)  = 
*4g^jj(x,t)  +  g^(x,t)  >  0;  H(x,t)  can  be  thought  of  as  the  payoff  rate  or  “rate 
of  winning”  at  the  point  (x,t).  Again,  changing  the  stopping  reward  function 
g(x,t)  by  adding  to  it  any  solution  of  the  backward  heat  equation  leaves  the 
solution  S  of  the  FBP  unchanged. 

It  should  not  be  surprising  that  there  is  a  close  relation  between  this 
general  optimal  stopping  problem  for  a  zero  drift  Wiener  process  in  the  (x.t) 
scale  and  the  general  problem  in  the  (y,s)  scale  which  was  defined  earlier;  a 
simple  change  of  variables  transforms  one  into  the  other  (see,  for  example. 

Van  Moerbeke,  1974a,  p,547).  In  spite  of  this  close  relation,  we  will  prefer 
to  work  with  the  statistical  problems  in  the  (y.s)  scale  and  the  gambling 
problems  in  the  (x.t)  scale  since  these  are  the  natural  scales. 

Two  special  cases  of  this  general  optimal  stopping  problem  in  the  (x,t) 


scale  will  be  considered. 
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Example  2.6.  Van  Moerbeke*s  garrbllng  problem.  Van  Moerbeke  (1974a,  1974b). 

A  ganbler  loses  an  amount  of  money  equal  to  the  amount  of  time  the  process  spends 
in  the  region  x  0  and  wins  an  amount  of  money  equal  to  the  amount  of  time  spent 
In  the  region  x  >0.  If  the  gant>ler  Is  permitted  to  stop  the  process  at  any  time 
t,  0  <  t  £  1,  what  Is  the  optimal  strategy?  • 

For  this  problem,  the  payoff  rate  H(x,t)  *  +  1  depending  on  whether  the 
process  is  in  the  positive  or  negative  x  half-plane;  clearly  the  gambler  should 
never  stop  in  the  win  region,  x>0.  A  naive  gambler  would  stop  as  soon  as  the 
lose  region,  x  _<  0,  was  entered,  but  it  may  pay  to  lose  a  bit  now  in  the  hope 

of  winning  in  the  more  remote  future.  The  reward  function  described  above  differs 
from 


(2.10) 


g(x,t)  *  1  -  t  +  2x2  fQp  X  >  0  , 


=  1  -  t 


for  X  £  0  , 


by  a  solution  of  the  backward  heat  equation.  Hence  this  problem  Is  equivalent 
to  the  special  case  with  reward  function  g(x.t).  Van  Hoerbeke  has  established 
that  the  optimal  solution  (g.C)  for  this  problem  Is  given  by 

C  =  {(x.t):  X  >  -a(1  -  t)**,  t  <  1)  , 

{2-11)  g(x,t)  =  2(1  -  t)(l  +  w2)  +  a(l  -  t)lw4,{w) 

-  (1  +  w2)[l  -  ♦(w)])/<,(a)  for  (x.t)  E  C. 

where  w  ■=  x/(l  -  t)**  and  a  =  0.5061  Is  the  solution  of  a*(a)  =  4.(0). 
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Example  2.7.  The  S^^n  problem  with  finite  horizon  .  In  the  infinite  horizon 
version  of  this  problem  a  ganfcler  is  allowed  to  view  successively  as  many  terms 
as  he  pleases  of  a  sequence  X^,  X^,  ...  of  Independent  random  variables  with 
cormon  distribution  F,  If  upon  stopping  at  time  n  the  gambler  receives  a 
payoff  of  S^/n,  where  5^  “  +  •»-  optimal  strategy? 

This  problem  was  first  studied  by  Chow  S  Robbins  (1965),  who  proved  the 
existence  of  an  optimal  stopping  rule  when  F  is  a  two  point  distribution. 

They  also  proved  the  intuitively  obvious  but  nontrivial  fact  that  an 
optimal  rule  is  to  stop  at  the  first  n  at  which  and  provided 

a  method  of  calculating  the  sequence  of  nunfcers  6^  in  principle.  Dvoretsky 
(1965)  and  Teicher  &  Wolfowitz  (1966)  proved  that  the  same  result  holds  for 
any  F  with  finite  second  moment  (the  B*s  depend  upon  F,  of  course).  Dvoretsky 
also  showed  that  if  F  has  zero  mean  and  unit  variance  then  0.32,...  £  £ 

4.06  ...  for  n  sufficiently  large,  and  conjectured  that  lim  6p/n^  existed. 

This  conjecture  was  proved  independently  by  Taylor  (1968),  Walker  (1969),  and 
Shepp  (1969),  who  found  0.8399  ...  as  the  limiting  value.  They  pointed  out 
that  considered  for  large  values  of  n,  this  problem  would  be  equivalent  to  its 

Wiener  process  analogue,  the  special  case  where  for  0  <  t  <  « 
g(x,t)  «  x/t  ; 

the  optimal  solution  (g,C)  for  this  problem  is  given  by 
c  =  ((x.t):  X  <  at**  .  0  <  t  <  -) 

g(x.t)  =  (1  -  a2)t'**4(w)/4(w)  for  (x.t)  E  c. 

where  w  =  x/t**  and  a  =  0.8399  Is  the  solution  of  a<t(a)  =  (1  -  a^)4(a)  . 

The  finite  horizon  variation  of  this  problem,  in  which  the  gambler  is 
permitted  to  observe  at  most  N  terms  of  the  sequence  X^ ,  X^,...,  has  been 
considered  by  J.  L.  Snell  &  H,  Tisdale  (1978).  A  normalized  form  of  the 
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continuous  time  version  of  this  problem  leads  to  the  special  case  where  for 
0  <  t  <  1, 

g{x,t)  =  x/t  ; 

It  is  this  particular  version  of  the  S^/n  problem  which  will  be  considered  here. 

In  the  remainder  of  this  section  we  briefly  preview  the  rest  of  this 
paper.  In  Section  3,  the  backward  Induction  methods  for  the  normal  and  binomial 
discrete  time  versions  are  described  together  with  alternative  versions  of 
continuity  corrections.  In  Section  4,  the  examples  we  have  presented  are 
discussed  to  illustrate  and  evaluate  the  continuity  corrections.  The  modified 
Anscombe  problem.  Example  2.5,  for  which  the  solution  is  known  illustrates  the 

case  of  a  symmetric  region  where  the  boundary  Is  monotone.  Example  2.6,  Van 

/ 

Moerbeke*s  gambling  problem,  illustrates  the  case  where  truncation  may  be  used 
to  capitalize  on  one-sided  stopping  regions.  Example  2.7  illustrates  the  case 
where  the  boundary  is  not  monotone. 

In  Section  5,  the  problem  of  computing  solutions  over  large  ranges  of  s 
values  is  addressed  by  a  technique  of  changing  Increments  in  s.  This  method  is 
used  to  present  numerical  results  for  the  important  classical  sequential 
analysis  problem.  Example  2.1,  and  one-armed  bandit  problem.  Example  2.2. 

Finally  in  Section  6,  a  new  example  is  Introduced.  This  is  the  Anscombe 
problem  with  ethical  cost  considerations.  It  is  new  in  two  senses.  It  has  not 
been  treated  before  in  the  literature.  It  is  different  from  Examples  2.1  to 
2.7  in  that  the  posterior  risk  on  stopping  depends  not  only  on  the  current 
position  of  the  Wiener  process  but  also  on  the  past  history.  This  problem 
can  still  be  solved  numerically  by  backward  Induction  or  It  can  be  transformed 
Into  a  stopping  problem  of  the  same  form  as  the  others. 
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3.  NUMERICAL  TECHNIQUES 

In  this  section  we  describe  the  techniques  to  be  employed  in  obtaining 
numerical  descriptions  of  the  solution  of  the  general  optimal  stopping  problem 
for  a  zero  drift  Wiener  process  In  the  (y,s)  scale  defined  at  the  beginning  of 
the  previous  section.  As  already  indicated,  the  basic  idea  is  straigh forward: 
the  process  Y(s)  which  is  a  Wiener  process  in  the  -s  scale,  is  approximated  by 
a  discrete  time  process,  and  backward  induction  is  used  to  solve  the  optimal 
stopping  problem  for  this  new  process.  Using  asymptotic  results  concerning 
the  relation  of  the  solution  of  the  discrete  time  problem  to  the  solution  of 
the  Wiener  process  problem,  the  discrete  time  solution  can  then  be  adjusted 
to  provide  an  approximation  to  the  solution  of  the  continuous  time  problem. 

A  natural  approximation  to  the  continuous  time  problem  results  if  one 
considers  the  discrete  time  problem  where  one  is  permitted  to  stop  only  on  the 
discrete  set  of  possible  values  of  s,  (s^  +  1a,  i  «  0,  1,  ...)  .  While  the 
value  of  s  decreases  by  A  between  these  successive  possible  stopping  times, 
the  process  Y(s)  changes  by  a  normal  deviate  with  mean  0  and  variance  a;  In 
effect,  the  Wiener  process  is  being  approximated  by  an  appropriate  sum  of 
independent  normal  random  variables.  At  any  point  (y,s)  where  s  corresponds  to 
a  permissible  stopping  time,  the  choice  between  either  stopping  at  this  point 
or  continuing  on  to  the  next  permissible  stopping  time  and  proceeding  optimally 
thereafter  is  made  on  the  basis  of  which  of  d(y,s)  or  E{d(Y(s  -  a)  ,s  -  a) |Y(s)  =  y) 
is  smaller.  Thus,  the  backward  induction  algorithm  which  yields  the  optimal 
solution  to  the  stopping  problem  for  this  discrete) time  process  Is  specified  by 

<j(y»s)  *  d(y,s)  for  s  »  , 

«  min[d(y,s),  E(d(y  +  Za*^,  s  -  a))]  for  s  >  s^  , 


(3.1) 
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where  Z  represents  a  standard  normal  deviate. 

This  approximation  Is  a  natural  one  since  the  discrete  time  problem  Is 
embedded  within  the  continuous  time  problem;  the  former  corresponds  to  the 
special  case  of  the  latter  where  one  is  permitted  to  stop  only  on  the  discrete 
set  of  values  of  s  given  by  {s^  +  iA,  i  »  0.  1,  . . . From  this  point  of  view 
it  is  obviobs  that  the  continuous  time  problem  is  more  favorable.  For  a  sequence 
of  values  of  A  approaching  0,  the  solution  of  the  discrete  time  problem  (both 
the  continuation  region  and  the  risk)  would  approach  that  of  the  continuous 
time  problem  in  a  monotonic  fashion. 

I  Note  that  the  evaluation  of  the  expectation  appearing  in  (3.1)  would 
require  a  numerical  integration  for  which  purpose  the  y  axis  would  also  be 
discretized.  Thus,  in  practice,  the  backward  induction  is  carried  out  on  a 
grid  of  (y,s)  points  each  of  which  is  classified  as  either  a  stopping  or 
continuation  point  during  the  course  of  the  computation. 

How  would  one  use  the  results  of  the  backward  induction  algorithm  (3.1) 
to  obtain  an  approximation  to  the  boundary  y(s)  of  the  continuation  region  for 
the  continuous  time  problem?  Chernoff  (1965b)  presents  a  detailed  Investigation 
of  the  relation  of  this  discrete  time  problem  to  the  continuous  time  problem; 
the  results  lead  to  two  distinct  methods  of  approximating  the  continuous  time 
boundary  y(s). 

The  first  method  consists  of  simply  adjusting  the  boundary  of  the  optimal 
continuation  region  for  the  discrete  time  problem;  this  boundary  is  determined 
by  the  "break-even*  points  y^(s)  at  which  d(y,s)  =  E{d(y  +  Za**,  s  -  a)) 

Chernoff  (1965b)  has  established  that 

y(U  “  y^(s)  tkA**  +  oCa**)  , 


(3.2) 
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where  the  sign  is  determined  so  as  to  make  the  continuation  region  for  the 
Wiener  process  problem  larger  and  k  *  -c(!j)/»^  0.5826,  where  c  is  the 

Riemann  zeta  function.  The  first  method  should  then  be  clear:  For  a  (reasonably 
small)  value  A,  carry  out  the  backward  induction  algorithm  and  obtain  the 
break-even  points  y^(s)  at  each  fixed  value  of  s.  Then  use  the  correction 
implied  by  (3.2)  to  approximate  y(s).  Note  that  since  the  entire  backward 
induction  is  carried  out  on  a  grid  of  (y,s)  points,  the  break-even  points  y^(s) 
would  only  be  obtained  approximately,  presumably  by  some  interpolation  or 
extrapolation  scheme  (Day,  1969,  provides  the  details  of  a  scheme  for  carrying 
out  the  backward  induction  together  with  an  interpolation  scheme  for  approx¬ 
imating  the  break-even  points  for  the  discrete  time  version  of  Example  2.3). 

We  shall  call  this  the  adjustment  method  and  label  it  A. 

For  the  second  method,  the  break-even  points  need  not  be  approximated. 
Chernoff  (-1965b)  has  established  that,  in  the  neighbourhood  of  the  boundary 
of  the  optimal  continuation  region  for  the  continuous  time  problem,  the 
difference  between  the  optimal  risk  for  the  discrete  time  problem  and  the  cost 
for  stopping  behaves  asymptotically  (as  A  -♦  0),  at  every  fixed  value  of  s, 
like  a  simple  function  which  depends  upon  the  (unknown)  location  of  the 
continuous  time  boundary  at  this  value  of  s  and  whose  form  he  provides;  indeed, 
it  is  this  result  which  leads  to  the  relationship  (3.2)  .  This  result  forms 
the  basis  of  the  second  method:  For  a  (reasonably  small)  value  of  A,  carry  out 
the  backward  induction  algorithm  to  obtain  the  optimal  risk  for  the  discrete 
time  problem  at  each  grid  point.  Then,  at  each  fixed  value  of  s,  fit  the  known 
values  of  the  difference  between  the  optimal  risk  for  the  discrete  time  problem 
and  the  cost  for  stopping  at  those  grid  points  In  the  interior  of  the  continuation 
region  (but  adjacent  to  the  boundary)  to  the  relationship  provided  by  Chernoff 
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(1965b)  in  order  to  approximate  (or,  more  precisely,  to  extrapolate  to)  the 
location  of  the  continuous  time  boundary  (further  details  for  a  closely  related 
scheme  will  be  provided  below).  We  shall  call  this  the  extrapolation  method 
and  label  It  E. 

While  the  discrete  time  process  with  normal  increments  is  the  most  natural 
approximation  to  the  Wiener  process,  we  propose  to  use  the  simpler  approximation 
in  which  the  Wiener  process  Y  is  replaced  by  the  simple  random  walk  process 
where  Y(s  -  a)  =  Y(s)  + A*^,  each  with  probability  1/2.  This  approximation  to  the 
Wiener  process  results  in  a  very  simple  corresponding  backward  Induction 
algorithm;  the  standard  normal  deviate  Z  in  (3.1)  is  replaced  by  a  random 

I 

variable  which  is  1,  each  with  probability  1/2;  leading  to  the  algorithm 

d(y,s)  =  d(y,s)  for  s  -  s^, 

(3.3) 

=  min[d(y,s),{d(y  +  A^,  s-  A)  +  d(y- a*^,  s- a))/2]  for  s  >  s^. 

Obviously,  this  algorithm  is  considerably  simpler  to  implement  than  that 
specified  by  (3.1)  which  requires  a  numerical  integration  to  evaluate  the  risk 
at  each  grid  point  (y.s).  As  was  the  case  with  the  previous  approximation, 
the  backward  induction  is  carried  out  on  a  grid  of  (y,s)  points;  in  the  present 
approximation,  however,  the  discretization  of  the  y^axis  Is  necessarily  related 
to  the  discretization  of  the  s-axis.  Whereas  the  Wiener  process  was  previously 
being  approximated  by  the  sum  of  its  Increments,  in  this  simpler  approximation 
the  increment  of  the  Wiener  process  is  itself  replaced  by  a  Bernoulli  random 
variable.  While  the  second  moment  of  the  Bernoulli  variable  is  chosen  to  match 
that  of  the  increment  it  is  replacing,  the  higher  even  moments  do  not  match. 

In  general,  therefore,  it  is  not  clear  whether  this  discrete  problem  is  more 
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or  less  favorable  than  the  Wiener  process  problem.  Further,  while  the  solution 
of  this  discrete  time  problem  (both  the  continuation  region  and  the  risk)  would 
also  approach  that  of  the  continuous  problem  as  A  approached  0,  one  would  not 
necessarily  expect  the  behavior  to  be  monotone. 

Chernoff  &  Petkau  (1976)  have  investigated  the  relation  of  this  discrete 
time  simple  random  walk  problem  to  the  original  continuous  time  problem.  They 
establish  that  the  appropriate  analogue  of  (3.2)  for  the  present  case  is 

(3.4)  y(s)  *  y^{s)  +  0.5a'^+ o(a*^), 

•and  also  provide  the  form  of  the  simple  function  which  describes,  for  each 
fixed  value  of  s,  the  asymptotic  (as  a  -►  0)  behavior  of  the  difference  between 
the  optimal  risk  for  this  discrete  time  problem  and  the  cost  for  stopping  in 
the  neighbourhood  of  the  boundary  of  the  optimal  continuation  region  for  the 
continuous  time  problem.  These  results  enable  the  same  two  general  approaches 
described  above  of  approximating  the  continuous  time  boundary  to  be  used  in 
connection  with  the  backward  induction  algorithm  (3.3).  Further  details  of 
these  methods  in  the  context  of  this  discrete  time  simple  random  walk 
approximation  will  now  be  provided.  For  simplicity  of  discussion,  we  will 
suppose  throughout  the  remainder  of  this  section  that  we  are  in  the  case  of  a 
one-sided  problem  where  the  optimal  continuation  region  for  the  continuous 
time  problem  is  given  by  C  =  {(y,s):  s  >  and  y  <  y(s))  ,  where  y(5)  is 
monotonically  increasing  in  s. 

To  implement  the  adjustment  approach,  the  break-even  points  y,(s)  at 

A 

which  d(y,s)  =  d*(y,s)  where 

‘l*(y.s)  =  {d(y  +  A**,  s  -  a)  +  d(y  -  A*^,  s  -  a))/2 


(3.5) 
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must  be  approximated  at  each  fixed  value  of  s  e  +  1a:  1  «=  1 ,2,  . . . }  . 

In  carrying  out  the  algorithm  (3.3)  at  s,  one  would  discover  the  grid  level 
Yq  “  yQi^)  on  the  y  axis  determined  by  the  condition  that  the  grid  points 
(Yq  -  Ja  ,  s)  =  (yj*s)  say,  be  classified  as  continuation  points  (d*  ^  d) 
for  J  =0,1,  ...  and  as  stopping  points  (d*  >  d)  for  j  =  -1,-2,  ...  .  The 
grid  level  ygCs)  might  be  called  the  highest,  or  last,  continuation  level 
at  s;  the  sequence  of  highest  continuation  levels  would  be  nondecreasing 
and  a  naive  approximation  to  y^(s),  the  break-even  point  at  s,  would  be 
provided  by  yQ(5).  Note,  however,  that  In  the  case  of  this  discrete  time 
random  walk  approximation,  the  grid  being  employed  has  a  vertical  spacing 
of  A  which  Is  coarse  compared  to  the  horizontal  spacing  of  a;  for  reasonably 
small  values  of  A,  therefore,  as  s  Increases  successive  values  of  yQ{s) 
would  often  be  Identical  and  this  naive  approach  would  produce  a  series  of 
steps  as  an  approximation  to  the  gradually  Increasing  sequence  of  break-even 
points.  One  might  attempt  to  smooth  the  sequence  of  levels  yQ(s)  to  form 
an  Improved  (hopefully)  approximation  to  the  sequence  of  break-even  points 
y^(s),  This  could  be  accomplished  by  the  crude  approach  In  which  y^(s)  Is 
approximated  by  yQ(s)  only  at  those  values  on  the  s  grid  where  the  last 
continuation  level  changes,  that  Is,  yQ(s)  >  yQ(s  -  A);  line  segments 
connecting  these  approximation  points  could  then  be  used  to  approximate 
y^(s)  at  any  Intermediate  value  of  s.  The  approximation  can  then  be  adjusted 
by  0.5a^  to  provide  the  crude  adjusted  estimate  of  y(s);  this  method  Is 
labelled  CA. 

The  above  method  of  approximating  the  break-even  points  nay  seem  crude 
since  the  computed  values  of  the  risk  at  the  grid  points  are  completely 
ignored,  except  that  they  are  employed  to  classify  the  grid  points  as  either 
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stopping  or  continuation  points  .  In  carrying  out  the  algorithm  (3.3),  the 

value  of  d-d*  Is  determined  at  each  grid  point;  at  each  fixed  value  of  s  then, 

the  values  of  d-d*  at  the  grid  points  could  be  used  In  an  Interpolation  to 

approximate  the  break-even  point  y^(s).  The  simplest  such  scheme  would  be  a 

linear  one  based  on  the  values  of  d-d*  at  yQ(s)  and  y.^(s)  =  ygCs)  +  the 

grid  levels  between  which  It  Is  known  that  the  break-even  point  y^(s)  lies. 

¥ 

Alternately,  one  might  employ  a  quadratic  Interpolation  scheme  based  on  the 

values  of  d-d*  at  either  y^(s),  yQ(s)  and  y_^(s)  or  ygCs).  and  y_2(s)* 

Day  (1969,  p.306)  points  out  that  for  two-sided  problems  with  normal 

Increments  where  d-d*  Is  syrmetrlc  and  convex  (In  y  at  each  s)  and  has  a 

monotone  decreasing  second  derivative,  these  two  quadratic  interpolations 

will  actually  yield  an  underestimate  and  an  overestimate  respectively  of  the 

break-even  point  y^(s).  This  suggests,  and  we  shall  use,  the  average  of  the 

two  interpolated  values  as  the  approximation.  The  estimates  of  y  (s) 

A 

I, 

described  here  can  be  adjusted  by  0.5a^  to  give  variations  of  A  which  may  be 
called  LA  and  QA  for  linear  adjusted  and  quadratic  adjusted. 

Each  of  the  above  adjustment  methods  Involves  adjusting  an  estimate  of 
y^(s).  It  is  possible,  at  considerable  computational  expense,  to  approximate 
the  points  y^(s)  more  precisely  by  repeating  the  discrete  backward  induction 
with  each  of  a  series  of  related  grids.  By  using  the  grid 

(3.6)  ((y.s):  s  «  s^  +  1A,  y  -  c  +  kA^;  1  *  0,1,  ....  k  -  0,+!,  ...} 

with  many  fractional  values  of  c/a^  (without  loss  of  generality,  we  assume 
0  <  c  <  A  ),  one  can  estimate  the  break-even  points  y^(s)  arbitrarily  well. 
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We  now  consider  EX,  an  analogue  of  the  extrapolation  method  E,  which 
bypasses  the  explicit  calculation  of  y  (s).  Defining 

A 

D(y,s)  =  d(y,s)  -  d(y,s)  , 

where  d  Is  the  optimal  risk  In  the  discrete  time  problem  (the  function 
evaluated  by  the  algorithm  (3.3)),  the  results  of  Chernoff  &  Petkau  (1976) 
Indicate  that  for  the  one-sided  problem  under  discussion,  at  each  fixed  value 
of  s,  one  should  expect 

(3.7)  DCWs)  '+  VA^.s)  =  -  H(;(s),s)r(v)A 

where  the  function  r(v)  is  given  by 

r(v)  =0  for  V  >  -1/2  , 

=  -  1nf(v  +  j)^  for  V  <  -1/2  , 

j 

(3.9)  H(y,s)  =  4  clyy(y.s)  -  d^iy.s) 

is  the  "rate  of  losing".  Suppose  then  that  the  algorithm  (3.3)  has  been 
carried  out  and  we  wish  tq  approximate  y(s).  At  those  values  on  the  s  grid, 
the  value  of  D(y,s)  is  available  at  yj(s)  for  j  =0,  1,  ...  (of  course, 

D  =  0  at  yj(s)  for  j  =  -1,-2,  ...).  If  we  represent 


(3.8) 

and 
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(3.10)  yjj(s)  ■  y(s)  +  VA*^  , 

«  4 

we  only  require  an  approximation  for  v.  Fitting  the  known  values  of  D  at 
yQ(s)  and  y^(s)  to  the  relation  (3.7)  leads  to 


(3.11) 


5  D(y^(s),s)  »  ar(-1  +  v) 


where  the  unknown  constant  a  •=  -H(y(s),s)  .  Assuming  as  suggested  by  (3.4) 
that  -llf<vs  -%,(3.11)  becomes 


(3.12) 


Dq  =  a{v^  -  (v  +  1)^  )  “  -a(2v  +  1)  , 
=  a{(v  -  1)^  -  (v  +  1)^1  =  -a(4v)  . 


Solving  the  system  (3.12)  leads  to  the  approximations 


(3.13) 


a  =  -D^/4v  , 

V  =  0,/2(2Dq  -  D,)  ; 


this  value  for  v  Is  then  substituted  Into  (3.10)  to  yield  the  extrapolation 
estimate  of  y(s):  this  method  Is  labelled  EX.  Note  that  In  the  special  case 
where  yQ(s)  Is  Itself  a  break-even  point,  Dq  •  0  and  this  extrapolation  scheme 
calls  for  estimating  y(s)  as  +  0.5a*,  while  In  the  case  < 0  the  scheme 
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calls  for  a  correction  which  Is  larger  than  0.5a^  ;  these  properties  agree 
with  what  is  suggested  by  (3.4). 

In  sumnary,  the  technique  which  we  propose  to  employ  to  solve  the  general 
optimal  stopping  problem  for  a  zero  drift  Wiener  process  in  the  (y,s)  scale  defined 
earlier  is  as  follows:  The  Wiener  process  Y(s)  is  approximated  by  a  discrete 
time  simple  random  walk  process  and  backward  Induction  Is  employed  to  solve  the 
optimal  stopping  problem  for  this  discrete  time  problem.  The  solution  of  the 
discrete  time  problem  is  then  adjusted  by  one  of  the  methods  CA,  LAp  QA  or  EX 
to  approximate  the  solution  of  the  Wiener  process  problem.  In  the  above,  details 
of  the  methods  of  adjusting  the  discrete  time  solution  have  been  discussed  in 
the  context  of  a  one-sided  problem  with  a  monotone  Increasing  boundary.  It  should 
be  clear  that  the  sane  methods  can  be  used  In  problems  with  more  complicated 
types  of  optimal  continuation  regions.  Further,  it  should  not  be  surprising  that 
exactly  the  same  techniques  can  be  employed  to  solve  the  general  optimal  stopping 
problem  for  a  zero  drift  Wiener  process  in  the  (x,t)  scale  defined  earlier. 

The  reader  will  already  have  noticed  that  while  we  have  dwelt  at  some 
length  on  adjusting  the  boundary  of  the  optimal  continuation  region  for  the 
discrete  time  problem  to  provide  an  Improved  approximation  to  the  boundary 
of  the  optimal  continuation  region  for  the  continuous  time  problem,  nothing 
has  been  said  about  how  one  might  similarly  adjust  the  optimal  risk.  In  order 
to  do  so,  a  relationship  between  the  discrete  and  continuous  time  risks 
analogous  to  the  relationship  between  the  boundaries  given  by  (3.4)  would 
be  necessary;  unfortunately,  no  such  relationship  is  known  at  present. 

In  the  next  section,  these  techniques  will  be  illustrated  on  some  of  the 
examples  described  in  Section  2;  the  behavior  of  the  optimal  discrete  time  risk 
as  an  approximation  (unadjusted)  to  the  optimal  continuous  time  risk  will  also 
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be  considered.  We  remark  that  for  certain  problems  there  are  a  nunijer  of  ways 
of  reducing  the  labor  involved  in  carrying  out  the  backward  induction  algorithm 
(3.3);  these  typically  depend  upon  the  particular  problem  under  consideration 
and  will  be  discussed  as  the  opportunity  arises  in  the  next  section. 
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4.  ILLUSTRATION  OF  TECHNIQUES 

In  this  section  we  Illustrate  the  behavior  of  the  general  technique  described 
in  the  previous  section  In  the  context  of  some  of  the  examples  presented  in 
Section  2;  each  example  has  Its  own  particular  features,  but  the  basic  algorithm 
Is  In  every  case  the  same.  While  application  of  this  technique  to  derive  refined 
estimates  of  the  optimal  boundary  and  risk  for  the  continuous  time  problem  would 
require  an  exorbitant  amount  of  computation,  nevertheless.  It  Is  extremely  easy 
to  program  and  relatively  coarse  grids  on  the  s  axis  yield  surprisingly  accurate 
estimates. 

The  (y,s)  problems  which  have  been  described  all  have  the  property  that  the 
Interval  of  possible  values  of  s  is  Infinite.  For  these  statistical  problems,  the 
region  of  large  values  of  s  Is  of  particular  Interest  since  It  corresponds  In 
each  case  to  the  “beginning"  of  the  problem  where  little  Information  Is  yet 
available.  The  question  of  how  one  obtains  estimates  in  a  practical  manner  for 
large  values  of  s  will  be  discussed  In  the  next  section;  In  this  section  we  restrict 

attention  in  each  case  to  the  interval  100  ^  s  ^ 

We  begin  with  the  examples  for  which  exact  solutions  are  known;  these  permit 
a  careful  examination  of  the  convergence  of  the  estimates  as  the  grid  spacing  is 
refined.  We  then  discuss  the  Implementation  of  the  techniques  for  the  other 
examples  and  present  a  few  results. 

Example  2.5.  Modified  Ans combe  problem.  This  problem  Is  synmetrlc  In  y  with 
optimal  continuation  region  C  =  ((y,s):  |y|  _<  y(s),  s  ^  1),  where  the  monotonically 
Increasing  boundary  y(s)  is  specified  by  1  -  ♦(y(s)/s*^)  =  s‘‘V2  Note  that 

y(s)  '(ii/2)^(s  -  1)  as  s  -►  1  and  y{s)  ~  (2s  log  s)^  as  s 
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Consider  carrying  out  the  algorithm  (3.3)  to  determine  the  solution  of 
the  corresponding  random  walk  problem,  using  a  grid  of  the  form  (3.6)  for 
some  value  of  c.  The  computation  proceeds  In  stages:  At  the  Initial  (zero-th) 
stage,  the  values  of  d  are  assigned  at  all  points  of  the  grid  corresponding 
to  the  final  value  of  s,  namely  s  ■  s^  ■  1.  At  the  kth  stage,  d  has  already 
been  evaluated  at  all  points  of  the  grid  corresponding  to  the  values  of 

s  *  1  +  JA,  for  j  «  0,  1 . k  -  1;  d  Is  then  evaluated  at  all  points  of 

the  grid  corresponding  to  s  =  1  +  kA  .  In  the  course  of  this  computation 
which  yields  the  optimal  risk  for  the  random  walk  problem,  each  of  the 
Individual  grid  points  Is  classified  as  either  a  stopping  point  or  a  continuation 
point  for  the  random  walk  problem.  Thus,  the  sequence  of  highest  continuation 
levels  corresponding  to  the  particular  grid  being  employed  are  determined  and 
any  of  the  methods  described  In  the  previous  section  can  be  employed  to  obtain 
an  approximation  to  the  continuous  time  boundary  y(s). 

While  this  computation  Is  straightforward,  there  are  a  number  of  fairly 
obvious  modifications  which  reduce  the  amount  of  computation  Involved  In 
carrying  out  the  algorithm  (3.3)  for  this  particular  problem.  First,  due  to 
the  symmetry,  we  have  d{-y.s)=  d(y,s)  at  each  s.  Using  a  grid  which  Is 
symmetric  about  y  *  0  (use  of  c  *  0  In  (3.6))  then  allows  attention  to  be 
restricted  to  the  positive  y  half>plane.  Second,  It  Is  Intuitively  obvious  and 
easy  to  show  that  the  sequence  of  break-even  points  for  the  random  walk  problem 
inherits  the  monotonicity  property  of  the  continuous  time  boundary  y(s).  Thus, 
at  stage  k  where  s  »  1  +  k-A,  the  grid  levels  0,a^,  2a*^,  y^d  +  (k  -  1)a), 
where  yQ(l  +  (k  -  1)a)  is  the  highest  continuation  level  corresponding  to 
s  »  1  +  (k  -  1)a,  are  known  to  be  In  the  continuation  region.  At  stage  k  then. 
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d  can  simply  be  assigned  the  value  of  d*  (see  (3.5))  at  these  grid  levels.  The 
minimization  indicated  by  the  algorithm  (3.3)  need  be  carried  out  only  at 
successively  higher  grid  levels  until  the  first  stopping  point  is  encountered; 
all  higher  grid  levels  will  also  be  within  the  stopping  region  for  the  random 
walk  problem.  In  fact*  for  reasonable  values  of  A,  the  minimization  need  be 
carried  out  only  at  the  single  grid  level  y^,(l  +  (k  -  1)a)  *  yM  +  (k  -  1)a) 

ij  ^ 

+  A  since  if  the  highest  continuation  level  does  change  at  stage  k.  it  will 
change  fromy^d  +  (k  -  1)a)  to  y_^(l  +  (k  -  1)a). 

These  computations  have  been  carried  out  for  a  sequence  of  grids  specified 
by  decreasing  values  of  the  grid  spacing  A.  Since  the  only  apparent  pattern 
in  the  size  of  the  errors,  e  =  y  -  y  of  estimation  of  the  continuous  time 
boundary  y(s)  was  a  very  slight  tendency  for  the  errors  to  decrease  as  s  increased* 
an  overall  suimiary  should  be  an  adequate  description.  Such  an  overall  sumnary 
for  each  of  the  methods  CA*  LA,  QA  and  EX  is  provided  in  Table  1. 

Examination  of  Table  1  reveals  that  while  methods  CA  and  QA  underestimate 
the  correction  required  to  approximate  the  continuous  time  boundary  for  coarse 
grid  spacings  and  overestimate  it  for  the  (more  reasonable)  finer  grid  spacings, 
method  LA  overestimates  the  correction  for  all  spacings  considered.  Method  EX 
underestimates  the  correction  for  coarse  grid  spacings,  but  this  bias  begins 
to  disappear  as  the  spacing  is  refined.  Perhaps  the  most  important  observation 
to  be  made  about  Table  1,  however,  is  the  apparent  relationship  between  the  size 
of  the  errors  made  and  the  grid  spacing  for  method  EX:  refining  the  grid  spacing 
in  s  by  a  factor  of  4  appears  to  reduce  the  size  of  the  errors,  as  measured  by 
either  Ave  (|e|)  or  Max  (Ie|),  by  a  factor  of  between  3  and  4  (note  that  if  the 
factor  truly  is  4,  this  implies  the  size  of  the  errors  Is  proportional  to  the 
grid  spacing  in  s).  Since  refining  the  grid  spacing  in  s  by  a  factor  of  4  involves 
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8  times  as  much  cotnputatlonal  work,  this  leads  to  the  rough  estimate  of  2.8  to 
3.7  times  as  much  work  required  to  reduce  the  size  of  the  errors  by  a  factor 
of  2  when  method  EX  is  employed.  Although  it  is  clear  that  the  size  of  the 
errors  made  by  the  other  methods  will  also  decrease  as  the  spacing  is  refined, 
the  actual  behavior  is  unpredictable  since  no  such  empirical  relationship  is 
obvious  for  these  other  methods.  The  table  clearly  indicates  that  while 
methods  CA  and  EX  should  not  be  used  with  coarse  grids,  these  become  the 
preferred  methods  with  the  (more  reasonable)  refined  grids.  It  should  be  noted 
that  all  four  methods  provide  excellent  approximations  to  the  continuous  time 
boundary  y(s)  when  reasonable  grid  spacings  are  employed. 

The  optimal  risk  for  the  discrete  time  simple  random  walk  problem  was 
also  examined  as  an  approximation  to  the  optimal  risk  for  the  continuous  time 
Wiener  process  problem.  A  crgde  summary  of  the  errors  in  this  approximation 
is  presented  in  Table  2.  This  summary  indicates  that  refining  the  grid  spacing 
in  s  by  a  factor  of  4  leads  to  a  reduction  in  the  size  of  the  errors  by  a 
factor  of  between  3  and  4  also.  Further,  the  table  clearly  indicates  that  the 
risk  in  the  discrete  time  simple  random  walk  problem  provides  an  excellent 
approximation  to  the  optimal  risk  for  the  continuous  time  problem,  even  for 
quite  coarse  grids. 

We  remark  that  in  contrast  to  the  continous  time  problem,  the  random  walk 
problem  under  consideration  here  has  the  property  that  the  continuation  region 
is  prematurely  truncated;  that  is,  there  exists  an  interval  on  the  s-axis, 
(1.Sf(A)),  on  which  none  of  the  grid  points  will  be  classified  as  continuation 
points.  An  easy  calculation  indicates  that,  for  small  values  of  A,  the  grid 
point  y  =  0,  s  =  1  +  kA  will  first  (as  successive  stages  of  the  backward 
induction  are  carried  out)  belong  to  the  continuation  region  for  the  random 
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walk  problem  when  k  *  (2iia)  '^  +  1  +  o(l).  While  this  represents  a  substantial 
number  of  successive  stages  only  for  very  small  values  of  a,  this  feature  could 
also  be  Incorporated  to  make  the  computation  more  efficient  for  such  small 
values  of  a. 

Example  2.6.  Van  Moerbeke*s  gairbling  problem^  This  gangling  problem  has  a 
one-sided  continuation  region  C  =  {(x,t):  x  >  x(t),  t  <  })  with  monotonically 
Increasing  boundary  x(t)  =  -a(l  -  t)*^.  where  a  “  0.5061  Is  the  solution  of 
a^{a)  =  ^(a).  Although  this  problem  is  formulated  in  terms  of  the  function 
g(x,t)  which  specifies  the  reward  received  by  the  gani>ler  upon  stopping  at  (x,t) 
and  is  given  in  (2.10),  the  problem  can  be  equivalently  formulated  in  terms  of 
the  stopping  cost  function 


d(x,t)  «  -g(x,t)  . 

The  appropriate  modification  of  the  algorithm  (3.3)  is  then  given  by 

d(x,t)  =  d(x,t)  fQP  ^  s  ] 

(4.1) 

=  min[d(x.t),  (d(x+A*^.t+A)  +  d{x-A’^t+a) )/2]  for  t  <  1. 

While  the  first  few  stages  of  this  algorithm  can  be  carried  out  analytically 
and  lead  to  break-even  points  x^(l  -  a)  =  0.  x^n-2A)  =  (-2+3*^)a*‘  =  -0.268a’*, 
XaO-36)  = -(4-lo’*)A**/2  » -0.419a’*,  and  so  on  (note  that  applying  the  ja’* 
correction  to  these  exact  break-even  points  would  lead  to  estimates  of  the 
continuous  time  boundary  of  x(l-A)  = -0.500a’*,  x(1-2a)=  -0.543(2a)’*, 
x(l-3A)=f-0.531(3A)  ,  and  so  on),  these  exact  calculations  become  unmanageable 
after  a  few  stages. 
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Carrying  out  the  algorithm  (4.1)  proceeds  similarly  as  in  the  case  of 
Example  2.5  and  any  of  the  methods  described  in  the  previous  section  can  be 
employed  to  obtain  an  approximation  to  thecontinuous  time  boundary  x(t). 

The  present  problem,  however,  has  its  own  special  features.  For  the  contin¬ 
uous  time  problem,  ((x,t):  x  >  0,  t  £  l)c  C;  this  fact  would  be  known  even 
if  the  exact  solution  were  unknown  since  the  “rate  of  winning", 

H(x,t)  •  9^(x»t)  >  0  for  x  >  0,  t  _<  1.  Since  It  can  easily  be 

shown  that  the  sequence  of  break-even  points  for  the  random  walk  problem 
Inherits  the  mono tonicity  property  of  the  continuous  time  boundary  x(t),  and 
since  x^(l  -  a)  “0,  the  above  result  is  also  true  for  the  discrete  time 
random  walk  problem.  Again,  it  can  be  shown  that  the  minimization  indicated 
by  the  algorithm  (4.1)  need  only  be  carried  out  at  a  single  grid  level  at 
each  stage  of  the  computation. 

The  fact  that  all  grid  points  above  the  x  axis  are  known  to  be  continuation 
points  can  be  incorporated  to  reduce  the  amount  of  computation  required  in 
carrying  out  the  algorithm  (4.1).  Consider  a  particular  path  of  the  random 
walk  process  originating  at  the  point  (x,t)  -  (c  +  1  -  nA).  The  path  of 

the  process  could  hit  the' grid  level  x  »  c  for  the  first  time  at  ^ 

t  =  1  -  (n  -  1)a,  1  -  (n  “  3)a,  alternately,  the  path  cauld  remain  above 

the  line  x  «  c  all  the  way  to  t  »  1.  Since  all  che  grid  points  (c,  1  -  ia) 
for  t  «  1,  2,  ...  are  continuation  points,  we  have  the  relation 

(4.2)  d(c+A*^,l-nA)  «  I  P  d(c,l-(n-m)A)  +  [q  .d(c+kA*^,l) 

m=l  k*l"**^ 

where  p^  is  the  probability  that  a  simple  random  walk  starting  at  the  origin 
first  passes  through  the  level  -1  at  the  step,  and  ^  is  the  probability 
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that  a  simple  random  walk  starting  at  the  origin  stays  above  the  level  -1  for 
the  first  n  steps  and  achieves  level  k  •  1  at  the  nth  step.  Feller  (1968,  p.89. 
Theorem  2)  provides  ’ 


-  1  f  m  ] 
■  ml(m+l)/2j 


for  m  odd  , 


for  m  even  ; 


for  m  positive,  +  3)  p,  =  1/2  and  Pjj,=  0.  Feller  (1968,  p.73. 

Ballot  Theorem)  also  provides 

1^  =  0  for  n  +  k  even  , 

'  ((n+k+!)/2  otherMise  . 

The  relation  (4.2)  provides  a  slight  modification  for  carrying  out  the 
backward  Induction  which  we  will  call  the  truncation  modification.  At  the 
Initial  (zero-th)  stage,  that  is  at  t  *  1,  the  risks  are  specified  by  d(x,t). 

At  any  subsequent  stage,  corresponding  to  t  *  1  -  nA  say,  compute  the  risk  at 
the  grid  level  x  *  c  +  by  means  of  (4.2).  The  risks  at  the  grid  levels 
X  =  c  +  kA^  for  k  =  0,  -1,  -2,  ...  can  be  computed  using  the  algorithm  (4.1) 
as  described  above. 

Returning  for  a  moment  to  the  continuous  time  problem,  we  have  already 
pointed  out  that  changing  the  stopping  reward  function  by  adding  to  it  any 
solution  of  the  backward  heat  equation  leaves  the  optimal  continuation  region 
unchanged.  For  present  purposes.  It  Is  convenient  to  consider  the  new  stopping 
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reward  function  g'(x,t)  defined  by 

g*(x,t)  =  g(x,t)  -  2(1  -  t  +  x^)  , 

or  the  new  stopping  cost  function  d'(x,t)  *  “g*{x,t).  Note  that  d*(x,l)  =  0 
for  x  ^  0.  The  algorithm  (4.1)  can  be  employed  to  obtain  the  optimal  risk 
d*(x,t)  for  the  discrete  time  random  walk  problem  corresponding  to  this 
version  of  the  continuous  time  problem;  In  this  case  the  relation  (4.2) 
simplifies  to 

^  n 

(4.3)  d’(c  +  A  ,  1  -  nA)  =  I  Pm^'(c.l  -  (n  -  m)A) 

^  m=l 


which  results  in  a  reduction  in  the  computation  Involved  in  carrying  out  the 
algorithm.  Limited  empirical  evidence  suggests  that  the  truncation  modification 
reduces  the  computation  time  required  by  a  factor  of  approximately  two  In 
those  cases  where  the  simplification  (4.3)  obtains. 

In  the  general  case,  the  transformation 

g'{x,t)  -  g(x.t)  -  /  (t,  -  tr’’*((x’-x)/(t,-t)*’)g(x’.t,)dx' 

produces  a  new  stopping  reward  function  with  the  same  optimal  continuation 
region  and  satisfying  g*(x,t^)  «  0  for  x^x^.  Unless  this  Integral  can  be 
explicitly  evaluated,  however,  no  real  simplification  obtains.  For  our  special 
function  g  In  (2.10),  this  Integral  (with  «  0,  t^  1)  does  not  coincide  with 
2(1  >  t  4  x^).  but  the  difference  Is  simply  a  solution  of  the  backward  heat 
equation. 

The  computations  have  been  carried  out  for  a  sequence  of  grids  specified 
by  decreasing  values  of  the  grid  spacing;  in  all  cases,  grids  of  the  form 
(3.6)  with  c  =  0  were  employed  .  Since  there  was  no  apparent  pattern  in  the 
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size  of  the  errors  e  =  x  -  x  of  estimation  of  the  continuous  time  boundary  x{t), 
an  overall  summary  of  these  errors  should  be  adequate.  Such  an  overall  summary 
for  each  of  the  methods  CA,  LA,  QA  and  EX  appears  In  Table  3. 

Table  3  reveals  that  while  methods  CA,  LA  and  QA  always  overestimate  the 
correction  required  to  approximate  the  continuous  time  boundary  (except  at  the 
coarsest  grid  spacing  in  the  case  of  CA),  such  a  severe  bias  is  not  apparent 
with  EX  although  the  method  does  tend  to  underestimate  the  correction  required. 
The  relationship  between  the  size  of  the  errors  made  and  the  grid  spacing  is 
quite  clear  for  methods  CA,  LA  and  QA:  refining  the  grid  spacing  in  s  by  a 
factor  of  4  appears  to  reduce  the  size  of  the  errors  by  a  factor  of  2;  for  method 
EX  the  reduction  factor  appears  to  be  about  3.  While  all  methods  provide 
excellent  approximations  to  the  continuous  time  boundary  x(t)  when  employed  with 
reasonable  grid  spacings,  the  preferred  method  would  appear  to  be  EX. 

A  crude  sunrnry  of  the  errors  in  the  approximation  of  the  continuous  time 
risk  by  the  optimal  risk  in  the  discrete  time  random  walk  problem  is  presented 
in  Table  4;  it  is  apparent  that- this  approximation  is  excellent  even  for 
relatively  coarse  grids.  Further,  it  is  clear  that  refining  the  grid  spacing 
in  t  by  a  factor  of  4  leads  to  a  reduction  in  the  errors  by  a  factor  of  4.  It 
Is  Interesting  to  note  that  in  this  example  it  appears  the  various  discrete 
time  random  walk  problems  are  uniformly  less  favourable  than  the  continuous 
time  problem.  Examination  of  isolated  grid  points  Indicates  that  the  risk 
in  the  discrete  time  problem  converges  monotonically  to  the  continuous  time 
risk.  These  observations  are  in  contrast  to  the  situation  in  Example  2.5. 

Recall  that  the  methods  CA,  LA,  and  QA  proceed  in  two  stages:  first  the 
break-even  points  for  the  discrete  time  random  walk  problem  are  approximated; 
these  are  then  adjusted  by  0.5a^  as  suggested  by  the  asymptotic  relationship 
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(3.4).  At  an  early  stage  of  these  investigations,  the  performance  of  this 
adjustment  of  0.5a  was  Investigated  in  the  context  of  Example  2.6.  For 
a  fixed  grid  spacing  A,  the  results  of  carrying  out  the  backward  Induction 
with  grids  of  the  form  (3.6)  with  c  «  0(0.0001 )a  were  combined  to  locate 
the  break-even  points  to  within  an  error  of  0.0001  at  the  expense  of  a 

very  substantial  amount  of  computing  .  The  errors  in  the  approximation  of  the 

continuous  time  boundary  by  both  the  "raw”  break-even  points  and  the  “adjusted" 
break-even  points  (adjusted  =  raw  -  0.5a^)  were  then  evaluated.  The  results 
for  a  few  grid  spacings  are  summarized  In  Table  5.  Note  that  Ave(|e|)  and 
Mdx(|e|)  are  similar  throughout  the  table;  this  indicates  that  the  errors  are 
roughly  constant  at  different  values  of  t.  As  expected  on  the  basis  of  (3.4), 
the  errors  viith  the  raw  break-even  points  are  very  close  to  0.5a  .  While  the 
adjustment  of  0.5a*^  is  slightly  too  large  for  each  grid  spacing,  this  error 
seems  to  decrease  faster  than  0.5  A*^  as  the  grid  spacing  decreases  (393/5000  = 

0.079,  156/2500  =  0.062,  58/1250  =  0.046).  Comparing  these  results  to  those 

in  Table  3,  it  becomes  clear  that,  for  this  problem,  while  method  LA  does  not 
estimate  the  break-even  points  very  accurately,  QA  does  reasonably  well, 
particularly  for  the  coarser  grid  spacings.  Method  CA  always  underestimates 
the  break-even  points  (for  this  problem  and  generally)  and  this  compensates 
for  the  fact  that  0.5a*^  Is  an  over- adjustment  here.  It  is  important  to  note 
that  the  errors  incurred  with  method  EX  are  very  similar  to  the  errors 
reported  in  Table  5  (compare  especially  Max(|e|));  for  this  problem  method 
EX  does  as  well  as  any  possible  method  based  upon  adjusting  estimated 
break-even  points. 

These  methods  can  be  adapted  for  all  of  the  examples  we  have  discussed. 

The  methods  employed  in  Example  2.5  apply  v/ithout  modification  to  Example  2.3. 
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A  slight  modification  was  required  for  Example  2.4;  attention  could  not  be 
resticted  to  the  positive  y  half-plane  since  the  problem  was  not  symmetric 
in  y.  Detailed  results  for  these  examples  have  already  appeared  in  Chernoff 
&  Petkau  (>981)  and  Petkau  (1978)  respectively.  In  the  remainder  of  this 
section  we  examine  the  behavior  of  these  methods  in  Examples  2.1,  2.2,  and  2.7. 

Example  2.1,  Sequential  analysis  problem.  This  problem  is 
syirmetric  in  y  with  optimal  continuation  region 
C  *  {(y,s);  |y|  s  y  (s),  s^O).  Asymptotic  expansions  for  the 
monotonically  increasing  boundary  demonstrate  that  y{s)  "  %  as  s  0  and 

y(s)  -  (3s  log  s)**  as  s  The  methods  employed  in  Example  2.5  apply 

without  modification,  and  the  random  walk  version  of  this  problem  is  also 
naturally  truncated;  an  easy  calculation  Indicates  that,  for  small  values  of 
A,  the  grid  point  y  ■  0,  s  =  kA  will  first  belong  to  the  continuation  region 
when  k  -  +  ...  . 

Although  the  desired  computations  can  be  carried  out  in  a  straightforward 
manner,  it  is  more  difficult  to  examine  the  performance  of  the  methods  since 
the  exact  solution  to  the  continuous  time  problem  is  unknown.  To  illustrate 
behavior  as  the  grid  spacing  decreased,  the  approximation  to  the  continuous 
time  solution  provided  by  a  given  method  with  the  most  refined  grid  spacing 
was  taken  as  a  baseline  for  that  method.  The  deviation  of  the  approximation 
obtained  with  a  less  refined  grid  spacing  from  this  baseline  is  surmarized 
in  Table  6.  The  disparity  among  the  approximations  obtained  by  the  different 
methods  with  each  spacing  employed  is  summarized  in  Table  7,  Table  7  indicates 
clearly  that,  in  this  example,  the  approximations  to  the  continuation  regions 
for  the  continuous  time  problem  produced  by  methods  LA  and  QA  are  strictly 
larger  than  that  produced  by  EX;  the  same  tendency  can  be  noted  for  CA. 


Relative  to  the  size  of  the  grid  spacing,  the  methods  CA,  QA  and  EX  agree  quite 
well  for  the  smaller  grid  spacings.  Table  6  indicates  that  while  methods  CA 
and  EX  improve  dramatically  as  the  spacing  is  refined,  the  improvement  is  less 
dramatic  for  LA  and  QA.  Overall,  the  patterns  here  appear  to  be  very  similar 
to  those  observed  in  Example  2.5. 

The  convergence  of  the  optimal  risk  in  the  random  walk  problem  as  the 
grid  spacing  decreased  was  also  examined.  The  optimal  risk  with  the  most 
refined  grid  spacing  was  taken  as  the  baseline.  The  results  as  summarized  in 
Table  8  and  are  not  unlike  the  results  obtained  in  Example  2.5. 

Example  2.2.  One-armed  bandit  problem,  this  problem  has  a  one-sided  contin¬ 
uation  region  C  =  ((y,s);  y  5^  y(s),  s  ^  1)  with  a  monotonically  decreasing 
boundary  y{s).  Asymptotic  expansions  demonstrate  that  y(s)  -  -a(s-l)^  as 
s  1,  where  a  *r  0.63884  is  the  solution  of  (a^  -  l)4>(a)  +  a®*(a)  ■  0,  and 
y(s)  “  -(2s  logs/^  as  s  -►  •».  The  first  few  stages  of  the  backward  induction 
algorithm  lead  to  break-even  points  y^(l  +  A)  =  0,  y^(l +  2a)  *  -a^(1+2a)/{3+2a) , 
y^(l+3A)  *  -4a^(1+a)(1+3a)/(7+15a+6a^),  and  so  on.  Addition  of  any  solution 
of  the  forward  heat  equation  to  the  stopping  cost  d(y,s)  given  in  (2.4) 
leaves  the  optimal  continuation  region  of  the  continuous  time  problem  unchanged. 
Upon  converting  to  the  new  stopping  cost  function  d*(y,s)  =  d(y,s)  +  y,  for 
which  d*(y,l)  =  0,  the  methods  enployed  in  Example  2.6  apply  to  this  example 
without  modification.  The  results  for  this  example  are  summarized  in  Tables 
9,  10  and  11.  Overall,  the  results  are  quite  similar  to  those  for  Example  2.1. 

Example  2.7.  The  S^/n  problem  with  finite  horizon.  Since  the  "rate  of 
winning"  for  this  gambling  problem  is  positive  for  negative  x,  this  region 
is  contained  within  the  optimal  continuation  region.  As  would  be  anticipated. 
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this  problem  has  a  one-sided  continuation  region  C  »  ((x,t):  x  <  x{t), 

0  <  t  £  1);  asymptotic  expansions  demonstrate  that  x(t)  -  a^t^  as  t  0, 
where  =  0.83991  is  the  solution  of  a4>(a)  +  (a^-lj^Ca)  =  0,  and 
x(t)  -  a^(l-t)^  as  t  -►  1 ,  where  *  0.63884  is  the  same  constant  which 
appears  in  the  asymptotic  expansion  of  the  boundary  for  the  one-armed  bandit 
problem.  The  first  few  break-even  points  for  the  random  walk  problem  are 
given  by  ijl-A)  =  0.  S<,(1-2a)  =  a*^(1-2a)/(3-2a)  .  x.(1-3a)“  4a'^(1-a)(1-3a)/ 
(7-15a+6a2),  and  so  on.  Since  the  sequence  of  break-even  points  will  not  be 
monotone,  si ightly  more  detailed  calculations  are  necessary  when  carrying  out 
the  backward  induction  than  was  the  case  in  Example  2.6.  However,  converting 
to  the  new  stopping  reward  function  g*(x,t)  =  g(x,t)  -  x,  for  which 
g'(x,l)  5  0,  allows  the  general  technique  employed  in  Example  2.6  to  be  used 
here  also.  The  results  for  this  example  are  summarized  in  Tables  12,  13  and 
14.  While  the  results  are  qualitatively  similar  to  those  in  the  previous 
examples,  a  fev/  features  should  be  noted.  Since  the  optimal  boundary  is 
dome-shaped,  it  is  clear  that  method  CA,  which  approximates  this  curved  surface 
by  a  flat  surface  in  the  region  of  the  maximum,  must  do  poorly  for  coarse 
grid  spacings.  While  both  LA  and  QA  produce  smooth  approximations,  method 
EX  produces  approximations  which  occassional ly  exhibit  a  lack  of  smoothness 
In  the  neighbourhood  of  values  of  t  at  which  the  highest  continuation  level 
changes;  this  tendency  is  nx)St  pronounced  with  coarse  grid  spacings  but 
persists  even  with  refined  grid  spacings.  Further,  since  the  optimal  risk 
approaches  infinity  as  t  0,  the  deviations  summarized  in  Table  14  become 
large  at  the  smaller  values  of  t;  indeed,  the  deviation  which  is  largest  in 
magnitude  in  each  case  occurs  at  t  =  0.04,  x  =  0.1  .  In  spite  of  these 
limitations,  the  results  presented  again  indicate  that  the  niethods  perforin 
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quite  well.  In  Table  15,  we  present  an  abbreviated  table  of  the  approximation 
to  the  boundary  of  the  optimal  continuation  region  for  the  continuous  time 
problem  obtained  from  the  computation  with  the  most  refined  grid  spacing.  Note 
the  accuracy  of  the  l-term  asymptotic  expansions  given  above  as  t  0  and 
t  1. 
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5.  PRACTICAL  IMPLEMENTATION  IN  STATISTICAL  PROBLEMS 

The  continuous  time  problems  described  In  Examples  2.1-Z.4  arise  from 
statistical  problems  and  share  the  property  that  the  range  of  possible  s 
values  Is  Infinite,  In  this  section  we  Indicate  how  the  numerical  methods 
which  have  been  described  can  be  employed  to  obtain  estimates  of  the  stopping 
boundary  and  the  Bayes  risk  for  these  problems  in  the  region  of  large  values 
of  s.  The  properties  of  the  proposed  technique  will  be  examined  in  the 
context  of  Example  2.5,  the  modified  Anscombe  problem,  and  sunmarles  of  the 
estimates  obtained  for  both  the  sequential  analysis  problem  and  the  one-armed 
bandit  problem  will  be  presented. 

While  the  results  of  the  previous  section  establish  that  estimates  obtained 
with  the  numerical  methods  are  accurate  provided  that  small  grid  spacings  A 
are  employed,  the  use  of  a  small  grid  spacing  In  a  backward  Induction  designed 
to  obtain  estimates  for  large  values  of  s,  say  out  as  far  as  s  «  10^,  would 
require  an  exorbitant  amount  of  computer  time.  On  the  other  hand,  while  the 
use  of  a  large  grid  spacing  will  allow  the  determination  of  reasonably  good 
estimates  at  large  values  of  s,  the  estimates  obtained  at  smaller  values  of  s 
would  typically  be  poor.  A  hybrid  technique  which  uses  a  small  grid  spacing 
at  the  Initial  stages  of  the  backward  Induction  and  larger  grid  spacings  at 
larger  values  of  s  is  required. 

A  naive  technique  of  this  sort  would  consist  of  carrying  out  a  number  of 
separate  backward  Inductions,  the  first  with  a  very  small  value  of  A  and 
successive  ones  with  successively  larger  values  of  A.  Each  of  these  backward 
Inductions  would  begin  at  s^,  the  Ini tlaV  value  of  s,  and  If  each  was  carried 
out  to  the  same  number  of  stages,  estimates  would  be  obtained  In  successively 
larger  overlapping  Intervals  of  s.  The  results  of  the  separate  backward 
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Inductions  could  then  be  combined;  at  any  fixed  value  of  s,  the  estimates  would 
be  obtained  from  the  backward  Induction  Involving  the  smallest  value  of  A  to 
reach  this  value  of  s.  Thus,  In  different  Intervals  of  s,  the  estimates  of  the 
Bayes  risk  and  the  stopping  boundary  for  the  continuous  time  problem  are  the 
estimates  obtained  In  different  approximating  discrete  time  simple  random  walk 
problems.  While  this  simple  technique  seemed  to  lead  to  adequate  estimates  In 
Petkau  (1978),  estimates  at  large  values  of  s  might  be  unnecessarily  crude 
slnc^  these  are  obtained  by  backward  Inductions  which  use  fairly  large  values 
of  A  even  at  the  Initial  stages. 

A  simple  way  of  avoiding  this  difficulty  Is  to  carry  out  a  single  backward 
induction  that  Incorporates  a  changing  step  size  as  It  proceeds.  The  first 
phase  of  this  backward  Induction  might  execute  stages  corresponding  to  a 
very  small  grid  spacing  A^,  from  the  Initial  value  s^  to  s^+M^*a^  *  s^  say, 
and  the  second  phase  might  execute  M2  stages  corresponding  to  a  larger  grid 
spacing  A2t  from  the  Initial  value  for  this  phase  of  S2  **  s|  to  S2+M2*A2  * 
say.  At  the  first  stage  of  the  second  phase,  estimates  of  the  risk  at  all 
the  new  grid  levls  at  $2  could  be  Interpolated  from  the  estimates  of  the  risk 
at  the  old  grid  levels  at  $2.  The  backward  Induction  could  be  continued  for 
as  many  phases  as  desired;  an  Interpolation  of  the  estimates  of  the  risk  would 
be  required  at  the  first  stage  of  each  successive  phase.  Of  course,  the 
estimates  of  the  Bayes  risk  and  the  stopping  boundary  for  the  continuous 
time  problem  which  are  obtained  In  this  way  do  not  correspond,  except  In  first 
phase,  to  the  estimates  which  would  be  obtained  from  any  particular  approxi¬ 
mating  discrete  time  simple  random  walk.  On  the  other  hand,  this  technique 
should  lead  to  more  accurate  estimates  at  large  values  of  s  than  the  naive 
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technique  described  above;  since  very  small  values  of  A  could  be  employed  In 
the  Initial  phases*  this  would  Insure  that  the  computations  at  later  phases 
of  the  backward  Induction  would  be  based  on  excellent  approximations  to  the 
Bayes  risk  for  the  continuous  time  problem  at  the  earlier  phases. 

Implementation  immediately  revealed  that  this  technique  led  to  slight 
discontinuities  In  the  estimates  of  both  the  Bayes  risk  and  the  stopping 
boundary  for  the  continuous  time  problem  at  the  values  of  s  which  marked  the 
transition  from  one  phase  to  the  next.  To  overcome  this  difficulty  the 
technique  was  modified  to  have  successive  phases  carried  out  on  overlapping 
Intervals  of  s.  Specifically,  the  first  phase  Is  carried  out  as  described 
above*  but  the  Initial  value  $2  for  the  second  phase* would  no  longer  be  s^ 
but  rather  some  value  of  s  intermediate  between  s^  and  s^.  The  estimates 
of  the  risk  obtained  at  this  intermediate  value  of  s  would  be  stored  during 
the  course  of  the  computations  in  the  first  phase*  enabling  the  Interpolation 
necessary  at  the  first  stage  of  the  second  phase  to  be  carried  out.  The 
estimates  of  the  Bayes  risk  and  the  stopping  boundary  for  the  continuous 
time  problem  at  values  of  s  In  the  overlapping  region  would  be  those  obtained 
with  the  finer  grid  spacing;  that  Is*  those  obtained  In  the  earlier  phase. 

This  modification  would  be  implemented  at  the  transition  from  each  phase  to 
the  next*  and  the  backward  Induction  could  be  continued  for  as  many  phases 
as  desired.  Empirical  evidence  Indicated  that  for  all  practical  purposes 
this  modification  removes  the  observed  discontinuities  provided  that  the 
overlapping  Interval  corresponds  to  a  sufficient  number  of  stages  of  the  next 
phase.  Although  what  constitutes  a  sufficient  number  of  stages  depends  upon 
the  particular  problem*  qur  experience  suggests  that  an  Interval  corresponding 
to  a  hundred  stages  of  the  next  phase  would  certainly  be  adequate. 
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This  technique  was  employed  in  Chemoff  and  Petkau  (1981)*  and  will  also 
be  employed  here.  The  overall  mechanics  of  the  proposed  technique  are  specified 
by  the  grid  spacing  to  be  used  and  the  number  of  stages  to  be  executed  In  each 
phase  of  the  backward  induction  and  the  extent  of  overlapping  to  be  employed 
from  each  phase  to  the  next.  We  have  not  systematically  explored  the  possible 
versions  of  the  technique*  but  rather  have  used  the  simple  version  in  which  the 
nurrber  of  stages  to  be  executed  is  the  same  In  all  phases,  the  grid  spacing  is 
increased  by  a  constant  multiple  from  one  phase  to  the  next,  and  the  extent  of 
overlapping  Is  a  fixed  fraction  of  the  Interval  of  s  values  over  which  the 
stages  of  the  previous  phase  were  executed. 

The  results  presented  In  the  following  were  obtained  using  the  technique 
with  2080  stages  in  each  phase,  the  grid  spacing  A  Increased  by  a  factor  of 
4  from  each  phase  to  the  next*  and  the  extent  of  overlapping  corresponding  to 
one-half  the  Interval  of  s  values  covered  by  the  previous  phase;  this  extent 
of  overlapping  corresponds  to  1040  stages  of  the  previous  phase  or*  since  A  Is 
increased  by  a  factor  of  4  from  each  phase  to  the  next,  260  stages  of  the 
current  phase.  Since  only  grids  centered  on  the  y-axis  were  employed  (use  of 
c=0  In  (3.6))*  use  of  the  factor  4  for  increasing  A  from  phase  to  phase  implies 
that  the  grid  at  the  previous  phase  Is  a  refinement  of  the  grid  at  the  current 
phase.  Consequently*  the  estimates  of  the  risk  at  the  new  grid  levels  at  the 
value  of  s  corresponding  to  the  first  stage  of  any  phase  are  provided  by  the 
estimates  of  the  risk  at  those  same  grid  levels  at  that  value  of  s  in  the 
previous  phase;  no  interpolation  Is  necessary. 

For  each  example,  the  grid  spacing  for  the  first  phase  was  taken  to  be 
A  *=  25  X  lO"^  and  estimates  were  obtained  out  to  s  »  10^.  The  estimates 
of  the  risk  were  obtained  as  described  above.  Estimates  of  the  boundary  were 
printed  out  whenever  the  grid  level  corresponding  to  the  last  continuation 
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level  changed;  the  estimates  at  these  values  of  s  were  obtained  by  method 
EX.  Subsequent  to  the  completion  of  the  backward  Induction*  an  estimate  of 
the  stopping  boundary  at  any  fixed  value  of  s  can  he  obtained  by  Interpolation 
from  this  listing.  Where  a  tabulation  of  the  stopping  boundary  Is  provided 
In  the  following*  linear  Interpolation  has  been  employed. 

Since  the  solution  of  Example  2.5,  the  modified  Ansconbe  problem,  Is 
available  In  closed  form  (see  (2.8)  and  (2.9)),  the  behavior  of  the  above 
technique  can  be  examined  In  detail.  A  crude  suinnary  of  the  accuracy  of 
the  estimates  of  the  risk  within  the  continuation  region  Is  provided  In 
Table  16.  This  suinnary  suggests  that  the  relative  errors  tend  to  be 
largest  close  to  y  *  0,  where  they  are  of  the  order  of  10  **; 

detailed  examination  of  the  errors  on  a  much  finer  grid  of  (s*z) 
values,  where  z  »  y/s  ,  suggests  the  empirical  upper  bound  of  3x10  on  the 
relative  errors  In  this  problem  when  the  proposed  technique  Is  employed  In 
the  manner  described  above.  A  suimary  of  the  errors  In  the  estimate  of  the 
stopping  boundary  Is  provided  In  Table  17.  The  largest  relative  errors 
(which  are  still  relatively  small)  occur  In  the  region  of  s  values  close  to  1 
where  the  stopping  boundary  y(s)  Is  close  to  0;  In  this  region,  asymptotic 
expansions  would  be  available  for  y(s)  and  could  complement  the  numerical 
results.  For  this  problem,  the  relative  errors  decrease  slightly  across  phases 
until  the  grid  spacing  exceeds  1  when  they  begin  to  increase  again.  The  errors 
themselves  Increase  across  phases  roughly  in  proportion  to  Ay,  the  size  of 
grid  spacing  on  the  y>ax1s  (at  least  as  long  as  the  grid  spacing  Is  less 
than  1;  after  this  the  rate  df  Increase  appears  to  be  a  bit  faster).  It  Is 
Interesting  to  note  that  the  estimates  of  the  boundary  are  ylways  overestimates 
(errors  >  0)  for  phases  1-6  and  underestimates  (errors  <  0)  for  phases  9-13, 
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Since  this  performance  of  the  proposed  technique  was  Judged  to  be  adequate 
for  our  purposes,  the  technique  was  implemented  in  exactly  the  same  fashion  for 
Examples  2.1  and  2.2.  Detailed  estimates  of  the  Bayes  risk  and  the  stopping 
boundary  for  these  problems  have  not  been  presented  in  the  literature;  we 
sumnarize  the  results  here. 

Example  2.1 .  Estimates  of  the  stopping  boundary  for  the  sequential  analysis 
problem  are  tabulated  in  various  scales  of  Interest  in  Table  18.  The  asymptotic 
expansions 

x(s)  =  y(s)/s  -  ^  s[l  "  ^  -  ...]  as  s  ^  0, 

z(s)  =  y(s)/s’*  -  I  s^2[l  -  17  s’  +  as  s  0. 

b(s)  =  1  -  4(z(s))  -7”  ass->0, 

can  be  used  to  extend  the  table  to  even  smaller  values  of  s.  On  the  other 
hand,  the  asymptotic  expansions 

x(s)  =  y(s)/s  -  s’**{log  s^  -  log(8ii)  -  6(1og  s^)"'  +  as  s 

z(s)  =  y(s)/s*’  -  {log  s^  -  log(8ii)  -  6(log  as  s 

b(s)  =  1  -  t{z{s))  -  2(s3log  s3)"'‘(1  +  [2  +  7  1og(8ii)](log  s^)"'  +  ...) 

as  s  ■+■  », 


perform  only  moderately  well  at  s  =  10^. 
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The  Bayes  risk  In  the  continuous  time  version  of  the  sequential  analysis 
problem  corresponding  to  starting  at  the  point  (yQ.s^,)  In  the  normalized  form  of 
the  continuous  time  version  (the  coordinates  y^j  and  s^  are  determined  by  the 
parameters  and  Og  of  the  prior  distribution  for  m  together  with  the  parameters 
k,  c  and  o;  see  the  discussion  of  Example  2.1  In  Section  2)  Is  given  by 

and  the  contribution  to  the  Bayes  risk  of  the  cost  of  sampling  Is  given  by 

.  ^.1,  _ 

where  S  is  an  optimal  stopping  rule  and  d(y,s)  Is  given  In  (2.2).  The  Bayes 
expected  sample  size  Is  obtained  by  dividing  the  Bayes  expected  cost  of 
sampling  by  c,  the  cost  of  sampling  associated  with  a  single  observation. 
E{d{Y(S),S))  can  be  approximated  by  the  techniques  described  above,  and  the 
expectation  E(S  can  be  approximated  In  a  straightforward  manner  during  the 
execution  of  the  backward  Induction.  For  simplicity  In  tabular  presentation 

I 

we  may  use  the  normalization 

BR  =  Bayes  rlsk/k^^^c’^^o^^^ 

=  E(d(Y(S).S))  -  s‘*  . 
and 

ECS  =  Bayes  expected  cost  of  sampl Ing/k^^^c^^^o^^^ 

-E(S->)  -  S-’  . 

where  both  BR  and  ECS  depend  only  upon  the  Initial  values  s^  and  y^  or  t  *  1/s 
and  Zq  »  y^j/Sp  »  representative  subsets  of  the  normalized  risks 

BR  and  expected  costs  of  sampling  ECS  which  have  been  evaluated  are  presented 
in  Tables  19  and  20  respectively.  The  behaviour  of  these  properties  of  the 
optimal  procedure  Is  also  Illustrated  In  Figures  1-4.  The  Bayes  risk  and 
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expected  cost  of  sampling  are  plotted  against  log(tp)  for  a  few  values  of 

Zp  In  Figures  1  and  2  respectively.  In  Figures  3  and  4  these  quantities  are 

plotted  against  Zp  for  a  few  values  of  tp.  The  asymptotic  behavior  Is  more 

clearly  Illustrated  In  Figures  5-8  where  log  BR  and  log  ECS  are  plotted 
against  logCtp)  and  Zp. 

The  tables  and  figures  reflect  the  form  of  the  asymptotic  expansions 
BR  ~  K  ^ 

ECS  ~  ♦(*„)  *0  "  “  ' 

provided  by  Chernoff  (1965a).  The  values  of  BR  and  ECS  for  -  10®  and 
Zq  »  0  suggest  K  ~  5.B9,  K'  •<  3.91;  regressing  the  values  of  BR/s‘’^^f(2jj)  for 

*0  *  . **  10  and  Zp  »  0  against  the  next  term  of  the  asymptotic 

expansion  leads  to  the  estimate  K  m  5.98. 

Example  2.2.  Estimates  of  the  stopping  boundary  for  the  one-armed  bandit 
problem  are  provided  In  Table  21.  The  asymptotic  expansions 

x(s)  •  ;(s)/s  -  -(s-1)'^{Cp  +  (c,  -  Cp)(s-1)  +  ...)  as  s  ^  1. 

t(s)  "  y(s)/s'*  -  -(s-l)**(Cp  -  -j-  Cp)(s-1)  +  ...)  as  s  -<•  1, 

e{s)  -  ♦(i(s))  -i~  (s-1)\+  [c,  as  s  -  1. 

-  CflO  +  +•••> 

where  Cp»  0.63883  and  c,  =  0.23625  are  defined  by 

Co«(Co)  +  ilc^)  -  0  .  c,  -  2co/(5  +  cp^)  . 


fit  very  well' for  values  of  s  close  to  1.  Here,  as  In  the  sequential  analysis 
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problem,  the  asymptotic  expansions  for  large  values  of  s 

*(s)  •  y(s)/s  -  -s'^^log  s2  -  21og(log  s^)  -  log{8ii)  +  as  s  - 

i{s)  -  y(s )/$'’  -  -{log  s2  -  21og(log  s^)  -  1og(8i.)  +  ...)**  as  s  - 

B(s)  •  *(2(5))  -  2s'’'(l  +  2/log  s2  -  ’[log  (log  s2)/log  s^]^  +  ...1 

as  s 

are  only  moderately  accurate  at  $  «  10^. 

The  Bayes  expected  payoff  In  the  continuous  time  version  of  the  one-armed 
bandit  problem  corresponding  to  starting  at  the  point  iy^.s^)  In  the  normalized 
form  of  the  continuous  time  version  (the  coordinates  y^  and  Sq  are  determined 
by  the  parameters  Up  and  Oq  of  the  prior  distribution  for  p  together  with  the 
parameters  N  and  o;  see  the  discussion  of  Example  2.2  In  Section  2)  Is  given 
by 

-°^‘’o’*y^fE{d(Y(S).S))  ♦  y^j/sj,], 
and  the  Bayes  expected  sample  size  Is  given  by 

where  S  Is  an  optimal  stopping  rule  and  d(y.s)  •  -y/s  for  s  a  1  Is  as  given 
In  (2.4),  Since  the  use  of  d'(y,s)  »  d(y,s)  +  y  ■  y(l  -  s’’)  In  place  of  d(y,s) 
simplified  Implementation  of  the  truncation  modification  (see  the  discussion 
of  Example  2.2  In  Section  4),  the  computations  for  the  Bayes  risk  employed  the 
Identity 

Bayes  expected  payoff  •  -  o^o*’sJ'2[E{d'(y(S).S)l  -  d‘(yjj.SQ)]. 

For  simplicity  In  tabular  presentation  we  may  use  the  normal fzatlon 
BEP  «  Bayes  expected  payoff/o^oQ^  , 


EN 


2-2 


*  Bayes  expected  sample  5lze/o“’Op 


and 
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where  BEP  and  EN  depend  only  upon  the  Initial  values  y^  and  Sq  or  Zp  «  ' 

-2  -2  -2 

^0  *  ^^^0  "  fraction  of  the  total  potential 

Information  which  Is  In  the  prior.  Small  representative  subsets  of  the 
normalized  quantities  BEP  and  EN  are  presented  In  Tables  22  and  23  respectively. 
The  behavior  of  these  properties  of  the  optimal  procedure  Is  also  Illustrated 
In  Figures  9  -  12. 

The  tables  and  figures  reflect  the  form  of  the  asymptotic  expansions 
BEP  ~  SQ{f(Zp)  +  as  Sg  +  »  , 

EN  ~  Sjj*(Zp)  *0  *  ”  • 

provided  by  Chernoff  and  Ray  (1965).  This  behavior  Is  more  clearly  Illustrated 
In  Figures  13-  16  where  log(BEp  +  1)  and  log(EN  +  1)  are  plotted  against 


log(tp)  and  z^. 
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6.  THE  ANSCOMBE  PROBLEM  WITH  ETHICAL  COST 

Armltage  (1963)  has  argued  that  the  iDodel  of  Example  2.3»  the  Ansconfce 
problem,  falls  to  deal  adequately  with  the  physician's  ethical  requirement 
that  he  provide  his  current  patient  with  the  treatment  he  believes  to  be 
best.  This  requirement  often  frustrates  attempts  to  gain  knowledge  to  benefit 
future  patients.  One  way  to  compromise  Is  to  modify  the  model  so  that  an 
additional  ethical  cost  is  attached  to  each  application  of  a  treatment  which 
the  physician  believes  to  be  Inferior.  In  this  section  we  present  results  for 
the  special  case  where  this  ethical  cost  Is  taken  to  be  proportional  to  the 
estimate,  based  on  the  current  posterior  distribution,  of  the  inferiority  |p|. 
This  consideration  of  ethical  costs  Introduces  a  fundamental  change  In  the 
nature  of  our  optimal  stopping  problem.  Fortunately  It  can  be  handled  with  a 
minor  modification  of  our  methods.  The  results  are  compared  to  those  of 
Chernoff  and  Petkau  (1981)  where  this  ethical  cost  Is  not  Included  In  the  model. 
We  begin  with  a  more  detailed  discussion  of  the  Anscombe  problem  without  the 
ethical  cost. 

The  discrete  time  formulation  of  the  model  for  the  Ansconbe  problem  Is 
described  briefly  In  Section  2.  The  expected  loss  or  posterior  risk  associated 
with  stopping  after  treating  n  pairs  of  patients  has  two  components.  The  first 
is  E(n|M|)  which  represents  the  expected  cost  in  patient  benefit  Incurred  during 
the  experimental  phase  where  n  of  the  2n  patients  treated  were  assigned  to  the 
Inferior  treatment,  and  the  second  Is  the  expected  cost  due  to  the  possibility 
of  selecting  the  Inferior  treatment  for  the  final  stage  and  thus  losing 
(N  -  2n)|M|. 
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If  p  Is  assigned  an  prior  distribution,  upon  observing  the 

differences  Xp  X^t  ....  X^^  In  response  for  the  first  n  pairs  of  patients  the 
posterior  distribution  of  p  becomes  W(Y^oS^)  where 


(6.1) 


^  1  x,)/(< 

i=l  ' 


,“2 


+  no‘^) 


+  no*^) 


For  n  >  m,  the  marginal  distribution  of  Y*  -  Y^,  If  we  treat  p  as  random.  Is 
-  s^)  and  Y*  -  Y*  Is  Independent  of  Y^  .  Thus  as  sampling  continues, 

* 

Y^  behaves  like  a  Gaussian  process  of  Independent  Increments  starting  from 
* 

'0  “  *^0*  Since  the  preferred  choice  of  treatment  for  the  remaining  N  -  2n 
patients  is  Indicated  by  the  sign  of  Y*.  the  expected  loss  or  posterior  risk 
associated  with  stopping  after  treating  n  pairs  of  patients  is  nE(|p|) 

+  (N  -  2n)E[max{0,-sgn(Y^)p)]  where  E  represents  expectation  with  respect  to 
the  posterior  distribution  of  p.  Straightforward  calculations  then  lead  to  the 
expression 


-  2n)|Y;| 

for  the  posterior  risk,  where  ')’(u)  •  4i(u)  +  u(*{u)  -  V )  =  y(  u  )  +  V  juj  and 
Y  is  defined  in  (2.3).  Using  (6.1)  the  posterior  risk  can  be  written  as 
d^(Yn.Sn).  where 


(6.2) 

d](y*.s*)  =  Ns*'^f(y*s* 

Here 

/ 

(6.3) 

s;'  =  +  iNo' 
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•nay  be  regarded  as  the  total  potential  Information  for  estimating  p.  The 
problem  of  selecting  the  best  sequential  procedure  for  terminating  the  experl- 
inental  phase  Is  equivalent  to  the  optimal  stopping  problem  where  the  Gaussian 
•process  Y*  is  observed  and  one  selects  the  stopping  time  n  to  minimize  the 
expected  risk  Ef‘*|{Y*,s*) ). 

A  natural  approximation  to  this  discrete  time  problem  results  If  the 
discrete  sequence  of  partial  sums  EX^  Is  replaced  by  the  continuous  time 
Wiener  process  X(t*).  with  drift  p  and  variance  per  unit  In  the  t*  scale 
(0  <  t  <  %N).  The  posterior  distribution  of  u,  given  X(t')  for  0  ^  t'  <  t*. 
Is  N(Y*,s*) ,  where 


ir*  -  Y*(s*)  =  {c-^o  +  o-^X{t*))/(oo^  "  s* 


In  parallel  with  the  above,  Y  (s  )  Is  a  Wiener  process  with  drift  0  and 
variance  1  per  unit  In  the  -s*  scale,  and  originates  at  the  Initial  point 
(yo«So)>  where  Sg  «  o^,  Yq  “  Y  (sg)  »  pg.  As  t  Increases  from  0  to  ^N, 
s  decreases  from  Sg  to  s*  as  defined  In  (6.3). 

The  posterior  risk  associated  with  stopping  at  (Y*,s*)  Is  d,(Y*,s*), 
and  this  continuous  time  problem  Is  equivalent  to  an  optimal  stopping  problem 
for  the  continuous  time  process  Y*.  Since  for  a  >  0  the  transformation 
^  replaces  Y*(s*)  by  a  Wiener  process  Y(s)  In  the  -s  scale, 

we  may  select  a  so  that  a^s.  -  1,  that  Is,  a  •  s;**  -  (o'z  +  VNo-^)’^.  Then 
the  Initial  point  (yg.Sg)  •  (ug,og*)  Is  transformed  to  (yg,Sg),  where 
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T'o'  *  *No*2)**  ,  Sg  =  Og2(Og='  + 

Setting  y  «  ay*,  s  «  a^s*,  from  (6.2)  we  have,  for  Sq  ^  s  ^  1  , 

d^(y*,s  )  =  Na'*s’*H’(ys''**)  -  ao^(l  -  s**)|y| 

■  o='o5>Sg’»{2(1  -  s5')s’*Y(ys'^)  -  (1  -  s-»)|y|) 

5  d2(y,s)  . 

Since  s^i'(Y(s)5"  )  Is  a  martingale,  the  term  Involving  s  t  satisfies  the  heat 
equation  and  does  not  affect  the  solution.  Hence  the  continuous  time  version  of 
the  Anscombe  problem  Is  equivalent  to  the  parameter- free  problem  where  the 
stopping  cost  Is 

daCy.s)  '  -(1  -  s"M|y|  . 

The  parameters  enter  only  In  the  determination  of  the  starting  point  (yQ*5Q) 
and  the  transformation  back  to  the  original  (X,t*)  scale. 

From  (6.4)  the  Bayes  risk  corresponding  to  starting  at  (ygiSp)  Is  given  by 

(6.5)  E{d2(Y(S),S)l  -  o2ojj‘>Sjj’‘[E(d3(Y(S),S))  +  2(1  -  Sg’ >5  0*  »(ygSg’*  )] 

where  S  is  an  optimal  stopping  rule;  the  quantity  E{d2(Y(S) ,S) )  can  be  approx¬ 
imated  by  the  techniques  described  earlier. 

After  observing  the  differences  In  response  for  the  first  n  pairs  of 
patients,  the  current  estimate  of  \i\s  Y*  .  To  Incorporate  the  ethical  cost. 
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* 

the  additional  cost  of  |t  where  y  Is  a  constant  of  proportionality. 

Is  Incurred  If  the  decision  Is  to  observe  another  pair  of  patients;  this 
additional  cost  corresponds  to  the  application  of  an  apparently  Inferior 
treatment  to  one  of  the  patients  in  the  pair.  During  the  experimental  phase, 
this  ethical  cost  is  accumulated  at  the  rate 


Y|Y*|dn  =  -o^yIy 


'ds 


•  which  corresponds  in  the  continuous  time  problem  to 

-o^yIY^Is*  *ds*  =  -o^dyly |s“^ds 

=  -a^OQ^sJ^YlYjs'^ds 


In  the  transformed  scale. 

The  Introduction  of  the  ethical  cost  has  changed  the  nature  of  our  problem. 
Basically  we  must  consider  not  only  the  cost  of  stopping  but  also  the  charge 
for  continuing  each  short  period  of  time.  There  are  two  equivalent  ways  of 
regarding  this  problem.  One  Is  In  terms  of  the  optimizing  backward  Induction 
and  the  other  Is  In  terms  of  the  diffusion  or  modified  heat  equation  satisfied 
by  the  risk  function.  The  former  Is,  for  s  >  1  and  Z  a  standard  normal  deviate, 

33(y,s)  =  m1n[d3(y,s).y|y|s‘^ds  +  ElB^Cy+ZCds)^,  s  -  ds))]  . 

with  natural  discrete  time  normal  and  Bernoulli  analogues  (compare  with  (3.1)). 

The  second  term  on  the  right  Incorporates  the  novel  cost  term.  It  leads 
to  the  following  free  boundary  problem  In  terms  of  a  nonhomogeneous  diffusion 
equation  (compare  with  (2.1)): 
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djjCy.s)  •  V«f3yy(y.s)  ♦  Y|y|s’^  for  (y.s)  t  C  . 

^^(yis)  *  <l3(y,s)  for  (y.s)  c  S  , 

d3y(y.s)  «  d3^(y.s)  for  {y,s)  c  aC. 

For  the  discrete  time  Bernoulli  analogue  of  the  backward  Induction  we  have 

(6-6)  d3(y.s)  «  d3(y,s)  for  s  »  1 , 

m1n[d3(y,s) ,Y|y| s  +  (d3(y+A^,s-A)  ♦  d3(y-a^,s-4)/2]  for  s  >  1, 

and  the  CA,  LA,  QA  and  EX  adjustments  can  be  calculated  In  the  same  way  as  before 
Using  the  discrete  time  versions  the  ethical  cost  accumulated  over  the 
Interval  s  to  s-A  Is  zero  when  Y(s)  «  0.  But  In  the  continuous  time  version  the 
expectation  of  the  ethical  cost  accumulated  over  the  same  Interval  would  be 
(Ignoring  the  constant  multiplier  the  positive  quantity 

-yE{|  |Y(u)|u"^du|Y(s)=0)  . 

In  general  the  difference  between  jyls^^A  and 

*E(j  |Y(u)|u*^du|Y(s)=y)  *>  “|y|s'U  2(s-A)''^A^f(yA’^) 

+  [  u"^(s-u)"^^(y(s-u)‘^)du 

's 

represents  one  source  of  error  in  our  approximations.  This  difference  can  be 
estimated.  Ignoring  the  constant  multlpler  o^Oq^Sq,  an  asymptotic  expansion 
shows  that  with  e  =  •^A/s  ,  C,  the  expectation  of  the  ethical  cost  accumulated 
over  this  Interval  In  the  continuous  time  version.  Is  approximated  by 

C  *  4y4»(0)s  +•••]  for  y  *  0  , 

“  Y|y|s  [e  +  •••]  for  y  0  , 

whereas  the  analogue  In  the  discrete  time  version  Is  ylyjs'^A  »  ylyjs'^e^  • 
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thus  our  approximation  Introduces  errors  of  order  O(c^)  «  . 

An  alternative  approach  to  the  ethical  cost  problem  consists  of 
transforming  It  to  an  equivalent  stopping  problem  without  the  nonhomogeneous 
cost  term.  In  this  particular  application  that  approach  Is  not  practical 
because  the  transformed  problem  Involves  a  stopping  cost  containing  an 
Integral,  the  evaluation  of  which  throughout  the  course  of  the  backward' Induction 
Is  too  expensive  to  be  worthwhile.  The  general  principle  may  be  of  some  Interest 
and  Is  presented  here. 

Given  Y(Sq)  *  y^,  5^  ^  s  ^  the  stopping  cost  corresponding  to  stopping 
at  Y(s)  *  y  Is 

d(y,s)  +  I(Sq.s) 

,  where 

I(Sq,s)  «  -[  c(y(u),u)du 

and  c(y,s)  Is  the  rate  of  accumulation  of  the  ethical  cost  when  Y(s)  -  y. 

This  stopping  cost  depends  not  only  on  Y(s)  and  s  but  also  on  the  path 
Y(s*),  Sp  s*  is. 

Let  Fj.  denote  the  sigma  algebra  containing  the  history  of  the  process 
from  Sq  to  s  i  Sf  .  Then 

M(s)  -  E{I(Sq.  s^)|F^}  -  E{I(Sp.s)|F^)  +  E{I($,s^)iFj) 

Is  a  martingale.  Moreover 


E{I(Sjj,s)  |Fj}  -  Ksq.s) 


and 


E{I(s.s,)|Fj)  •  -J  E{c(Y(u).u)|Fj)du  -  h(y(s).s)  say  . 


Thus,  the  stopping  cost 


d(lf(s),s)  +  Ksq.s)  ■  d(Y(s),$)  -  h(Y(s),s)  +  H(s) 
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may  be  expressed  as  a  function  of  V(s)  and  s  plus  a  martingale.  But  the  expecta¬ 
tion  of  the  martingale  Is  Independent  of  the  stopping  rule  and  the  optimal  stop¬ 
ping  rule  Is  the  same  as  for  the  problem  with  stopping  cost 

d'^y,s)  -  d(y,s)  -  h(y,s)  , 
for  which  our  methods  apply. 

In  our  special  problem,  the  function  h  Involves  an  Integral  of  the  form 
(  u-’(s-u)-S(y(s-u)-^')du 

^S 

which  would  have  to  be  evaluated  numerically  throughout  the  course  of  the 
backward  Induction.  Since  this  was  Judged  to  be  Impractical,  the  first  approach 
was  employed  here;  from  (6.5)  the  approximation  to  the  Bayes  risk  in  the 
continuous  time  problem  corresponding  to  the  starting  point  (ypt^Q)  Is  given  by 

{djCyg.So)  +  2(1-Sq^)s^  *^(^0*0**^^ 

where  d^  Is  evaluated  by  the  backward  Induction  algorithm  (6.6). 

Properties  of  the  optimal  stopping  rule  In  addition  to  the  Bayes  risk  can 
also  be  approximated.  For  the  continuous  time  problem,  direct  calculation  shows 
that  the  contribution  to  the  Bayes  risk  of  the  post-experimental  phase  (where 
all  the  remaining  patients  are  assigned  to  the  treatment  which  Is  Inferred  to  be 
superior)  Is  given  by 

(6.7)  oVJsJ[2E{(l-S-'')S^t(Y(S)S-*)}) 

while  the  Bayes  expected  sample  size  (number  of  pairs  of  patients  treated  during 
the  experimental  phase)  Is  given  by 

(6.8)  o^o'%(E(s‘’)  -  s'b  . 

The  two  expectations  appearing  In  these  expressions  can  be  approximated  In  a 
straightforward  manner  during  the  execution  of  the  backward  Induction  which  leads 
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to  the  approximation  of  the  Bayes  risk* 

Some  of  the  results  of  such  computations  for  the  Anscombe  problem 
without  ethical  coat  were  reported  in  Chernoff  and  Petkau  (1961)|  there 
d^(y,«)  -  dj(y,«)  +  2.’''^*ty»"’''^)  , 

-  -(1-B“’)|y|  +  , 


-  |y|.-'  +  2.''Ulyj 
was  employed*  The  term  added  'to  d^  is  a  solution  of  the  heat  equation  and 
therefore  does  not  affect  the  optimal  policy.  It  was  expected  to  contribute 
to  numerical  stability  since  for  large  |y|a  it  is  approximately  |y|  and 
cancels  the  major  part  of  d^  and  is  important  when  s  is  large.  In  this 
case,  d^  is  replaced  by  d^  in  the  algorithm  (6.6)  and  the  approximation  to 
the  Bayes  risk  in  the  continuous  time  problem  corre8(>onding  to  the  starting^ 
point  <yQ*®Q)  i»  given  by 
<6.9> 

These  computations  have  been  carried  out  for  the  cases  y  *  0  (the 
hnscombe  problem  without  ethical  cost),  0.1,  1*0  and  10.0.  Ihe  computations 
were  implemented  in  exactly  the  fashion  described  for  Examples  2*5,  2.1  and 
2.2  in  Section  5f  2080  stages  were  carried  out  in  each  phase,  the  grid 
spacing  A  was  increased  by  a  factor  of  4  from  each  phase  to  the  next,  and 
the  extent  of  overlapping  corresponded  to  one-half  of  the  interval  of  s 

values  covered  by  the  previous  phase.  For  each  case  the  grid  spacing  for 

-6 

the  initial  phase  was  taken  to  be  A  ■■  25  k  10  and  estimates  were  obtained 
out  to  8  "  10  *  The  entire  computation  for  the  individual  cases,  which 
included  evaluation  of  the  Bayes  expected  sample  size  and  the  prop»ortlon  of 
the  Bayes  risk  due  to  the  experimental  phase  as  well  as  the  Bayes  risk, 
required  between  28  and  35  seconds  of  CPU  time  at  a  cost  of  between  $2.00 
and  $2.50  on  the  12-megabyte  Amdahl  470  V/B  at  the  University  of  British 


Columbia 


57 


The  optimal  procedure  for  the  continuous  time  problem  may  be 
described  by  the  stopping  bbundary  3^(t)  -  1  -  ♦{z^(t)},  presented  for  the 
cases  under  consideration  in  Table  24  and  interpreted  as  follows.  Define 
Z  -  Y(a)/8’'^  -  y  (s  )/8 

the  number  of  standard  deviations  that  the  current  Bayes  estimate  of  p  is 
away  from  zero,  and 

t  «  l/s  -  S  /s^  «  (o^  -ft  o  )/(Oq  ♦  J  No  ^),  ' 

the  currently  available  proportion  of  the  total  potential  information.  If 
at  any  time  0  »  1  -  #(|z|)  <  0^(t),  stop  taking  observations  and  for  the 

remaining  N  -  2t  units  of  time  use  the  treatment  in  accord  with  the  sign  of 

* 

y  •  Note  that  3  is  the  observed  P  value  for  a  one-sided  test  of  |i  »  0  based 
on  the  data  and  the  prior.  At  time  t,  the  curve  2^(t)  specifies  the  number 
of  standard  deviations  required  for  stopping  and  3^(t)  is  the  corresponding 
nominal  significance  level.  Thus  the  optimal  procedure  may  be  described  as 
a  sequence  of  repeated  significance  tests  with  the  nominal  significance 
level  varying  with  the  amount  of  Information  available!  as  the  proportion  of 
information  available  increases  from  0  to  1 ,  the  nominal  significance  level 
becomes  leas  stringent,  increasing  from  0  to  1/2.  The  optimal  boundaries 
are  plotted  in  the  (8,t)  scale  in  Figure  17.  Note  that  for  a  given  value  of 
t,  Bayes  estimates  of  p  further  from  zero  are  required  for  stopping  for 
larger  values  of  Y#  the  ethical  coat  parameter!  that  is,  larger  values  of  y 
imply  earlier  stopping. 

Although  Figure  17  provides  a  clear  overall  comparison,  the  exact 
form  of  the  stopping  boundaries  near  the  distinguished  points  t  -  0,  where 
few  patients  have  been  treated,  and  t  -  1,  where  nearly  all  the  patients 
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have  been  treated,  ia  of  particular  Interest.  An  asymptotfic  expansion  for 
values  of  t  close  to  1  yields 

-  1/2  - 

where  is  the  unique  positive  solution  of 

♦(c)  -  (1+t)c*J(c)i 

% 

for  the  values  T  -0.0,  0.1,  1.0  and  10.0,  -  0.7642,  0.7401,  0.5972  and 

0.2893  respectively.  An  asywptotlc  expansion  for  small  values  of  t  yields 

-2  log  t  -  r ^  +  log  ♦  iog(2v(UY)^)  ♦  2^“^  ♦  , 

T  Y  T  Y 

-  (l+Y)t{l  4  3  (log  t)"^/4). 

Since  small  values  of  t  are  particularly  relevant  for  problems  Involving 
large  values  of  the  horlron  size  M,  it  is  important  to  note  the  accuracy  of 
the  approximation  8^(t)  ^  (1+y)t  for  small  values  of  t  in  Table  24. 

While  comparison  of  the  stopping  boundaries  indicates  the  effect 
of  the  ethical  cost  on  the  optimal  stopping  rules,  of  possibly  greater 
interest  are  the  risks  incurred  when  these  optimal  procedures  are  employed. 
These  risks  depend  upon  the  five  parameters  o,  N  and  y.  For 

simplicity  in  tabular  presentation  we  may  use  the  normalization 

BR  ■  Bayes  risk/a^c^^  , 

where,  as  is  clear  from  (6.9),  0R  depends  only  upon  y  in  addition  to  the 
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initial  values  of  t  and  Z,  namely 
t, 


-2,,  -2  1  -2, 
%  /<<^0  ^  2 


0  0  ' ' ^0  2  ^  '  “0 
A  small  representative  subset  of  the  normalized  risks  BR  which  have  been 

evaluated  are  presented  in  Table  25.  In  each  case  the  normalized  Bayes 
expected  sample  size 


2-2 

EN  *  Bayes  expected  sample  slze/o  <7^ 

and  the  proportion,  PR,  of  the  Bayes  risk  resulting  from  the  experimental 
phase  where  one-half  of  the  patients  are  assigned  to  the  inferior  treatment 
are  also  tabulated^  these  quantities  are  computed  according  to  (6.8)  and 
(6.7)  respectively. 

For  fixed  values  of  t^  and  z^,  the  Bayes  risk  Increases 
monotonies lly  with  yi  the  tabulated  values  provide  an  indication  of  the 
magnitude  of  the  effect  of  the  ethical  cost.  The  tabulated  values  of  EN 
reflect  the  differences  In  the  stopping  rules  which  are  evident  in  Table  24 
as  well  as  Figure  17,  and  translate  these  differences  into  more  meaningful 
quantities.  Note  that  for  small  values  of  t^,  the  ethical  cost  has  little 
effect  on  PR,  the  proportion  of  the  Bayes  risk  due  to  the  experimental 
phase.  The  leading  term  of  an  asymptotic  expansion  for  t^  small  and  z^  not 
large  indicates  that 


2-1  2 

Bayes  risk  ^00^  ( Ity) f (z^) ( log  t^)  . 

This  result  explicitly  indicates  the  effect  of  the  ethical  cost,  and  means 
that  the  order  of  magnitude  of  the  optimal  Bayes  risk  is  (log  N)^  which  may 
seem  surprisingly  small.  These  asymptotic  expansions  for  the  Bayes  risk  and 
the  optimal  stopping  boundaries  can  be  obtained  by  the  techniques  described 
in  Chernoff  and  Petkau  (1901). 


60 


The  behavior  of  these  Bayes  properties  of  the  optimal  procedure  Is 

Illustrated  in  rlgures  18-23.  The  Bayes  risk,  Bayes  expected  sample  sire, 

and  proportion  of  the  Bayes  risk  due  to  the  experimental  phase  at  O  are 

plotted  against  log(t^)  -  -logCs^)  in  Figures  18,  19  and  20  respectively. 

Whil*  the  quadratic  nature  of  the  dependence  of  the  Bayes  risk  on  log  s^  for 

large  values  of  is  Clearly  indicated  in  Figure  18,  Figure  19  indicates 

that  the  Bayes  expected  sample  size  grows  at  a  considerably  faster  rate. 

These  trends  are  even  more  apparent  when  the  same  quantities  are  plotted 
2 

against  (logCt^))  ,  although  such  plots  are  not  included  here.  These  same 
plots  for  other  values  of  z^  yielded  similar  patterns.  In  Figures  21,22  .and 
23  these  same  quantities  at  t^  -  10“^  (s^-  10^)  are  plotted  against  z^i  the 
same  plots  for  other  values  of  t^  yielded  similar  patterns. 

The  results  presented  were  all  obtained  using  the  backward 
induction  (6.6)  with  d^  replaced  by  d^.  This  algorithm  approximates  the 
expectation  of  the  ethical  coat  accumulated  over  the  interval  a  to  s— A  in 
the  continuous  time  version  by  the  ethical  cost  accumulated  over  the  same 
interval  in  the  discrete  time  version,  thereby  introducing  errors  of  order 
0(c  ),  where  c  »  A/s.  Since  c  <  0.003  in  our  implementation  of  this 
algorithm,  these  errors  should  have  negligible  effect. 

The  investigation  of  the  convergence  properties  of  two  different 
versions  of  the  backward  induction  algorithm  provides  detailed  information 
on  the  magnitude  of  this  effect.  Version  1  is  that  described  above  while 
version  2  is  the  modification  obtained  by  replacing  the  term  ylyjs  ^A  * 
ylyjs  ^  in  (6.6)  with 
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c  -  t4(0)s“^^^(2c/(1-€^)  4  log(C1-€)/(l4€))]  for  y  -  0, 

*  Y|y|*  [l/(t-*c  )  -  1 )  for  y  0| 

except  for  terms  of  order  0{c%(yB"^^^c*S )  In  the  case  of  y  #  0,  c  is  equal 
to  C,  the  expectation  of  the  ethical  cost  accumulated  over  the  interval  s  to 
s-A  in  the  continuous  time  version. 

The  computations  carried  out  arc  similar  to  those  described  for 
Examples  2.1  and  2.2  in  Section  4|  the  algorithm  is  executed  over  the 
Interval  1  <  s  <  100  for  each  grid  In  the  sequence  specified  by  A  -  4**^  for 
3,  4*  For  each  version,  the  approximation  to  the  continuous 
time  solution  provided  by  the  results  for  the  most  refined  grid  spacing  is 
taken  as  baseline  and  the  deviation  from  this  baseline  of  the  approximation 
obtained  with  a  less  refined  grid  spacing  is  examined.  The  results  for  both 
versions  in  the  case  y  ■  1  are  summarized  in  Table  26  and  are  qualitatively 
similar  to  the  results  obtained  in  Examples  2.1  and  2.2.  Note  that  the 
correction  required  to  approximate  the  continuous  time  boundary  is 
underestimated  In  both  versions.  On  the  other  hand,  while  version  1  results 
in  underestimates  of  the  continuous  time  risk,  version  2  results  in 
overestimates . 

Of  greater  interest  in  the  present  case  is  the  examination  of  the 
behaviour  of  the  differences  between  the  results  produced  by  the  two 
versions  as  the  grid  spacing  A  decreases.  The  differences  in  the  estimates 
of  both  the  boundary  and  the  risk  for  the  computations  described  above  are 
summarized  in  Table  27.  The  results  clearly  indicate  that  the  differences 
in  the  estimates  of  the  Bayes  risk  produced  by  the  two  versions,  as  measured 
by  either  the  maximum  or  average  difference,  are  directly  proportional  to  A, 
the  grid  spacing  in  s.  Either  version  will  produce  excellent  approximations 
to  both  the  boundary  and  the  risk  of  the  continuous  time  problem  %#hen 
reasonable  grid  spaclngs  are  employed. 
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7,  SUMMARY  AND  COMMENTS 

We  have  presented  a  method  for  obtaining  numerical  solutions  for 
optimal  stopping  problems  Involving  a  stopping  cost  d(y,s)  when  the  Weiner 
process  Y(s)  In  the  -s  (s2Sj)  scale  stops  at  (Y(S).S)  -  (y.s).  The  main 
idea  of  this  method  Is  to  approximate  the  Weiner  process  by  a 
discrete  time  process  with  Independent  Bernoulli  Increments 
I.e.  *  + 1  with  probability  %  and 


(7.1) 


■  'o  -  “ 


The  optimal  stopping  procedure  for  a  stopping  cost  d(y»s)  associated  with 
the  above  discrete  time  process  may  be  derived  by  the  backward  Induction 
scheme  with  the  following  simple  recursion  equation  for  the  optimal  risk 
d(y,s) 

I 

(7.2)  d{y,s)  “  iii1n(d(y.s)  ,  [d(y+A'*,s-fi)+d(y-fl’‘.s-fl)]/2)  ; 


the  optimal  stopping  procedure  calls  for  continuation  when  d(y,s)  <  d(y,s) 
and  stopping  otherwise. 

If  the  boundaries  for  the  optimal  stopping  problems  for  continuous  and 
discrete  time  are  denoted. by  y  and  y^,  then  the  approximation 

y  •  i  o.sa** 


(7.3) 
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furnishes  the  basis  for  a  considerable  Improvement  in  accuracy.  Unfortunately 
a  single  backward  Induction  calculation  provides  dCy^s)  only  on  a  rectangular 
grid  of  points  and  y^  Is  not  calculated  directly  and  may  be  In  error  by  as 
much  as  A^.  Several  alternate  continuity  correction  methods  were  described  to 
compensate  for  this  difficulty.  Three  simple  methods  of  estimating  y^  are  the 
crude  adjusted  (CA).  linear  adjusted  (LA),  and  quadratic  adjusted  (QA).  A 
fourth,  more  refined,  method  called  the  extrapolation  method  (EX)  Is  based  on 
the  solution  to  a  simple  discrete  time  stopping  problem  which  also  provides 
the  theoretical  basis  for  (7.3).  It  Involves  the  calculation  of  O(y.s)  « 
d(y,s)  -  d(y,s)  at  the  two  continuation  points  closest  to  y^(s)  for  each  s 
on  the  grid. 

This  approach  Is  fundamentally  unsound  as  a  numerical  method  to  derive 
refined  approximations  with  accuracy  to  many  significant  digits.  To  Increase 
accuracy  by  cutting  A  In  half  Involves  Increasing  the  numerical  work  by  a 
factor  of  8.  Without  continuity  corrections  this  would  Increase  the  accuracy 
by  a  factor  of  2.  As  determined  by  numerous  calculations  on  several  examples, 
one  obtains  surprisingly  good  results  for  crude  Intervals  A.  Moreover  as 
A  0,  the  use  of  EX  seems  to  divide  the  error  by  3  to  4  when  A^ 

Is  cut  In  half  Indicating  that  doubling  the  accuracy  requires  only  about 
three  times  as  much  numerical  computation. 

Several  variations  of  the  basic  approach  are  occasionally  useful  In 
reducing  the  computing  effort.  (1)  If  results  are  desired  over  a  very  large 
range  of  s  values,  then  It  was  suggested  that  a  small  value  of  A  be  used  for 
a  range  of  s  values,  followed  by  a  larger  value  of  A  over  an  overlapping 
range  of  s  values,  etc.  (7)  When  the  optimal  continuation  region  Is  unbounded 
In  y,  a  truncation  procedure  was  described  where  d(y,s)  need  not  be  calculated 
fory  >  c  If  y  25  c  Is  in  the  continuation  region  for  all  s  >  s-j.  This  method 
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depends  on  the  probability  that  the  (Y^.s^)  process  originating  at 
(c  +  A**,s)  will  reach  (c,s^)  for  some  <  s.  It  Is  particularly  useful 
when  d(y«s)  »  0  for  y  >  c  and  s  *  s^.  Moreover,  a  transformation  of  d 
(to  be  discussed  shortly)  which  reduces  the  computational  effort  and 
does  not  affect  the  optimal  stopping  boundary  can  be  applied  to  make 
d  ■  0  for  y  >  c  and  s  »  S| .  (3)  When  d(y,s)  is  symmetric  In  y.  It  Is 
possible  to  restrict  calculations  to  values  of  y  ^  0  thereby  reducing 
the  numerical  work  by  half. 

The  qriginal  continuous  time  stopping  problem  has  a  solution  which 
can  be  described  in  terms  of  a  free  boundary  problem  (FBP)  Involving  the 
heat  equation.  Related  to  that  Is  the  fact  that  If  one  adds  a  solution  of 
the  heat  equation  to  the  stopping  cost  d(y,s),  the  optimal  stopping  region 
is  not  affected  and  the  risk  Is  increased  by  this  solution  of  the  heat 
equation.  This  fact  Is  a  special  case  of  the  more  general  fact  that  If 
d(Y(s),s)  Is  Increased  by  a  martingale  M(s),  the  optimal  stopping  procedure 
Is  not  affected.  These  properties  were  used  in  the  truncation  variation 
of  the  proceeding  paragraph.  They  were  used  In  one  of  the  examples  where 
d  and  d  became  large  to  reduce  d  and  thereby  attain  numerical  stability. 

Finally,  they  were  used  in  the  Ansconhe  problem  with  ethical  cost  to 
transform  that  problem  to  a  stopping  problem  with  stopping  cost  d(Y(s),s). 

Eight  applications  were  considered.  Several  consisted  of  problems 
with  known  solutions  so  that  the  numerical  accuracy  of  the  methods  could 
be* evaluated.  Several  consisted  of  old  problems  of  Importance  In  the 
statistical  literature  so  that  refined  calculations  of  the  solutions  could 
be  presented.  These  Include  the  sequential  analysis  and  one-armed  bandit 
problems.  Finally  the  Anscorrfce  problem  with  ethical  cost  represents  a  new 
problem  whose  solution  may  be  regarded  as  having  potential  value  in  applications. 
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One  method  of  describing  the  optimal  stopping  procedure  for  some  of 
these  problems,  which  derive  from  observations  on  a  Wiener  process  with 
unknown  mean  with  a  normal  prior  distribution.  Is  In  terms  of  a  nominal 
significance  level  B  -  1  -  ♦(|y|s*^).  This  description  can  be  used  to 
Interpret  the  optimal  procedure  as  a  sequence  of  repeated  significance 
tests  where  the  significance  level  Is  not  held  constant,  but  depends  on 
the  amount  of  Information  collected  to  date. 

The  general  approach  is  easily  adaptable  to  decomposing  the  optimal 
risk  into  parts  representing  terms  such  as  the  cost  of  sampling,  the  cost 
of  error,  etc.  It  may  also  be  applied  to  evaluate  alternative,  non-optimal 
procedures  although  that  was  not  done  In  this  paper  and  the  refinement  due 
to  the  correction  (7.3)  and  to  the  use  of  EX  is  not  meaningful  then. 

Many  problems  originate  as  discrete  time  or  discrete  time  and  discrete 
process  problems.  For  example, the  rectified  sampling  Inspection  problem  is 
such  a  problem  where  the  fraction  defective  In  a  lot  is  compared  to  a  fixed 
nunfcer  Pq.  The  continuous  time  version  of  that  problem  is  the  one-armed 
bandit  problem  which  Is  approximated  by  our  approach.  But  the  solution  of  the 
latter  problem  Is  only  an  approximation  to  the  solution  of  the  sampling 
inspection  problem  which  Involves  a  Bernoulli  process  with  increments  which 
have  probability  p^  and  1  -  Pq  respectively.  The  theorem  which  provides 
the  approximation  (7.3)  also  provides  a  similar  approximation  relating  y 
and  the  optimal  boundary  for  the  original  discrete  time  sampling  inspection 
problem.  This  approximation  is  discussed  In  Chernoff  and  Petkau  (1976). 

The  idea  of  using  a  discrete  approximation  to  a  wiener  process  problem  which 
itself  approximates  a  discrete  time  problem  is  not  as  circular  as  It  seems. 

Our  numerical  calculation  Is  particularly  simple  partly  because  we  can  choose 
the  intervals  in  s  to  suit  our  taste.  Moreover  the  Wiener  process  version 
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of  the  problem  often  allows  normalizations  which  permit  us  to  solve  many 
problems  at  once. 

A  general  purpose  program  designed  to  handle  a  large  variety  of 
these  stopping  problems  should  be  capable  of  taking  advantage  of  the 
special  features  of  particular  problems  which  might  allow  the  necessary 
computational  effort  to  be  substantially  reduced.  Although  It  Is  possible 
to  write  such  a  general  purpose  program,  one  should  anticipate  that 
special  versions  may  occasionally  require  Intelligent  Intervention  to 
avoid  numerical  difficulties  such  as  underflows,  overflows  and  round  off 
errors.  For  example,  using  these  techniques  rather  careful  programming 
was  required  to  obtain  a  good  approximation  to  the  optimal  stopping 
boundary  In  the  problem  with,  stopping  cost 

<l(y.s)  »  mln(y.O)  exp(-l/s)  for  s  ^  0  . 


discussed  by  Bather  (1983). 
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TABLE  1.  ERRORS  IN  ESTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2.5.* 


Grid  Spacing 

s  y 

Method 

CA 

LA 

QA 

EX 

1 

1 

Ave(  e  ) 

-1690 

8 

-818 

-1676 

Ave(|e| ) 

1690 

209 

818 

1676 

Max(|e| ) 

3358 

813 

1276 

2857 

c* 

r' 

Ave(  e  ) 

-266 

283 

-91 

-419 

Ave(|e|) 

266 

283 

93 

419 

Max{|e| ) 

649 

466 

197 

666 

4-2 

2-2 

Ave(  e  ) 

-14 

209 

29 

-101 

Ave(|e|) 

29 

209 

29 

104 

Max(|e|) 

113 

315 

55 

175 

4‘3 

2-3 

Ave(  e  ) 

19 

116 

34 

-22 

Ave(|e|)' 

19 

116 

34 

26 

Max{|e|) 

36 

180 

48 

52 

4*1. 

2-'* 

Ave(  e  ) 

11 

70 

23 

7 

Ave(|e|) 

11 

70 

23 

9 

Max(|e|) 

16 

96 

30 

17 

*In  each  case,  the  errors  sunmarlzed  are  e  *  (y  -  y)  x  10*»  at  s  =  25tl)100; 
for  this  range,  y  varies  between  10  and  26. 
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TABLE  2. 

ERRORS  IN  ESTIMATION  OF  RISK 

FOR  EXAMPLE  2.5 

-* 

Grid  Spacing 

s  y 

Ave(e) 

Ave( |e|) 

Max(  le|) 

1 

1 

-587 

2391 

9162 

4“i 

2-> 

-243 

576 

1515 

4-2 

2-2 

-lie 

178 

531 

4-3 

2-3 

-34 

48 

148 

4-M 

2-4 

-9 

13 

39 

*In  each  case,  the  errors  sumnarized  are  lO’^xe  =  optimal  risk  In  discrete 
time  problem  -  optimal  risk  In  continuous  time  problem  at  all  grid  points  on 
the  Intersections  of  the  lines  s  =  25(1)100,  y  =  0{l)«and  within  the  contin- 
uatlon  region  for  the  discrete  time  problem.  Note  that  Ave(e)  f  Ave((e|) 
demonstrates  that  It  Is  not  the  case  that  the  various  discrete  time  random 
walk  problems  are  uniformly  less  favourable  than  the  continuous  time  problem 
In  this  example  (In  fact,  these  discrete  versions  are  on  the  average  more 
favourable  here);  nor  Is  It  the  case  that  the  convergence  is  monotone  at 
fixed  (y,s)  grid  points. 

Note  that  the  optimal  risk  for  this  problem  Is  synmetrlc  In  y,  always  negative, 
and.  for  fixed  s,  becomes  Increasingly  negative  as  |y|  Increases;  Inside 
the  continuation  region  the  risk  decreases  from  -4.0  to  -10.3  at  s  =  25 
and  from  -8.0  to  -25.8  at  s  =  100. 
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TABLE  3.  ERRORS  IN  tSTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2.6.* 


Grid  Spacing 

Method 

t 

X 

CA 

LA 

QA 

EX 

1(-2) 

K-i) 

Ave(  e  ) 

-65 

-1121 

-357 

194 

Ave( |e|) 

106 

1121 

357 

237 

• 

Max(|ej) 

307 

1529 

460 

436 

4-'(-2) 

2'*(-1) 

Ave(  e  ) 

-51 

-560 

-197 

51 

Ave(|e|) 

51 

560 

197 

71 

Max(|e|) 

129 

788 

257 

140 

4'*(-2) 

2-H-\) 

Ave(  e  ) 

-37 

-281 

-102 

13 

Ave(le|) 

37 

281 

102 

24 

Max( |e|) 

64 

404 

138 

62 

4-^(-2) 

2'M-1) 

Ave(  e  ) 

-17 

-140 

-52 

3 

Ave( |e|) 

17 

140 

52 

8 

Max{  |e|) 

23 

204 

73 

20 

4-(-2) 

2“'(-l) 

Ave(  e  ) 

-7 

-71 

-26 

1 

Ave{|e|) 

7 

71 

26 

3 

Max(|e|) 

10 

104 

38 

10 

*In  each 

case,  the 

errors  suiimarized  are  e 

“  (x  -  x) 

x  10®  at  t 

-  0(0.01)0.75; 

for  this 

range,  x 

varies  between 

-0:25  and 

-0.51. 

**  In  this  and  all  following  tables  a(-n)  represents  ax  10”'^. 
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TABLE  4c  ERRORS  IN  ESTIMATION  OF  RISK  FOR  EXAMPLE  2,6.* 


Grid  Spacing 

t  X 

Ave(e) 

Ave(|e|) 

Max( |e|) 

l(-2) 

K-l) 

658 

658 

2126 

4'‘(-2) 

2'M-l) 

148 

148 

537 

4-^(-2) 

2'^(-l) 

36 

36 

14P 

4-®(-2) 

2-3(-1) 

9 

9 

37 

4--(-2) 

2-‘'(-1) 

2 

2 

7 

*In  each 

case,  the  errors 

summarized  are  10"® xe 

*  optimal  risk 

'  ■  i  -  - 

in  discrete 

time  problem  -  optimal  risk  in  continuous  time  problem  at  all  grid  points 
on  the  intersections  of  the  lines  t  «  0(0.01)0.75,  x  =  0(-0.1)-<»  and  within 
the  continuation  region  for  the  discrete  time  problem.  Ave(e)  =  Ave(|et) 
indicates  the  various  discrete  time  random  walk  problems  are  uniformly  less 
favourable  than  the  continuous  time  problem. 

Note  that  for  the  version  of  the  problem  being  considered  the  optimal  risk  is 
always  negative  in  this  portion  of  the  continuation  region  and,  for  fixed  t. 
becomes  increasingly  negative  as  x  decreases  from  0;  in  this  portion  of 
the  continuation  region  the  risk  decreases  from  -0.18  to  -0.83  at  t  =  0.75 
and  from  -0.72  to  -3.32  at  t  =  0. 
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TABLE  5.  ACCURACY  OF  ADJUSTMENT  (3.4)  FOR  EXAMPLE  2.6.* 


Grid  Spacing 

■ 

t 

X 

Ave(e) 

Ave(|e|) 

Hax(|e|) 

U-2) 

i(-i) 

Raw 

4607 

4607 

4637 

Adjusted 

-393 

393 

436 

r>(-2) 

2-'(-1) 

Raw 

2344 

2344 

2362 

« 

Adjusted 

-156 

156 

178 

4-"(-2) 

2-^(-l) 

Raw 

1192 

1192 

1203 

Adjusted 

-58 

58 

69 

•In  each 

case,  the  errors 

summarized  are  e 

»  (x  -  x) 

X  10®  at  t  =  0(0.01)0.75; 

for  this 

range,  x  varies 

between  0.25  and  0 

.51. 
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TABLE  6.  DEVIATIONS  IN  ESTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2.I.* 


Grid  Spacing 

5  y 

Method 

CA 

LA 

OA 

EX 

1 

1 

Ave(  d  ) 

-1454 

239 

-687 

-1869 

Ave(|d|) 

1454 

381 

687 

1859 

Max(|d|) 

3299 

880 

1474 

3592 

4'> 

2-1 

Ave(  d  ) 

-259 

298 

-76 

-473 

Ave(|d|) 

266 

300 

86 

478 

Max(|d|) 

677 

540 

246 

919. 

4-2 

2-2 

Ave(  d  ) 

-14 

149 

23 

-Ill 

Ave(|d|) 

35 

152 

28 

127 

Max(|d|) 

140 

302 

58 

228 

/}-3 

2' 3 

Ave(  d  ) 

9 

67 

14 

-26  . 

Ave(ldl) 

12 

81 

15 

34 

Max(|d|) 

27 

128 

34 

55 

•The  computation  with  grid  spacing  in  s  =  4“'',  In  y  =  2“**  provides  the  baseline 
for  each  method.  In  each  case,  the  deviations  summarized  are  d  =  (y^  -  y2)xlO'^ 
at  s  ®  25(1)100,  where  y2  is  the  approximation  to  the  continuous  time  boundary 
at  baseline  and  y^  is  the  approximation  at  the  grid  spacing  listed  (both 
computed  by  the  same  method).  For  this  range  of  values  of  s,  y  varies  between 


11  and  31. 
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TABLE  7.  DEVIATIONS  IN  ESTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2. I.* 


Grid  Spacing 

Method 

s  y 

CA 

LA 

QA 

1  1 

Ave(  d  ) 

435 

2182 

1212 

Ave(|d|) 

794 

2182 

1212 

Max(|d|) 

2222 

3571 

2578 

4-1  2'  * 

Ave(  d  ) 

234 

845 

428 

Ave( |d|) 

309 

845 

428 

Max(|d|) 

702 

125 

809 

4-2  2-2 

Ave(  d  ) 

117 

334 

164 

Ave(|d|) 

124 

334 

164 

Max( |d|) 

238 

527 

248 

4*3  2-3 

Ave(  d  ) 

55 

166 

70 

Ave{|d|) 

55 

166 

70 

Hax(|d|) 

91 

236 

100 

4-'.  2"‘* 

Ave(  d  ) 

20 

74 

30 

Ave( |d|) 

20 

74 

30 

Max{|d|) 

32 

113 

45 

*In  each  case,  the 

deviations  suninarized  are  d  ==  (y 

“  y£j()  X  10**  at 

s  =  25(1)100 

where  y£jj  is  the  approximation  obtained 

using  method 

EX  at  the  grid  spacing 

under  consideration 

1.  For  this  range  of 

s  values,  y 

varies  between 

11  and  31. 
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TABLE  8. 

DEVIATIONS  IN  ESTIMATION  OF 

RISK  FOR  EXAMPLE  2.1, 

* 

Grid  Spacing 

s 

y 

Ave(d) 

Ave( |d|) 

Max( |d| ) 

1 

1 

210 

288 

1139 

4“i 

2-1 

-5 

73 

457 

4-2 

2-2 

-9 

20 

,137 

4’ 3 

2-3 

-3 

5 

33 

*In  each  case,  the  deviations  summarized  are  10®  times  the  differences 
between  the  optimal  risk  In  the  random  walk  problem  With  the  grid  spacing 
listed  and  that  with  grid  spacing  In  s  =  4“**,  In  y  =  2“**  at  all  grid  points 
on  the  intersections  of  the  lines  s  *  25(1)100.  y  =  0(1)«  and  within  the 
continuation  region  for  the  discrete  time  problem  with  the  less  refined  grid, 
spacing. 

Note  that  the  optimal  risk  for  this  problem  is  symmetric  in  y,  always  positive, 
and,  for  fixed  s,  decreases  as  |y|  increases;  inside  the  continuation  region 
the  risk  decreases  from  0.30  to  0.06  at  s  =  25  and  from  0.17  to  0.01  at  s  =  100. 
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TABLE  9.  DEVIATIONS  IN  ESTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2.2.* 


Grid  Spacing 

s  y 

Method 

CA 

LA 

QA 

EX 

1 

1 

Ave(  d  ) 

1107 

-308 

481 

1227 

Ave(|d|) 

1107 

330 

481 

1227 

Max(|d|) 

2417 

627 

870 

2187 

4-1 

2-> 

Ave(  d  ) 

164 

-310 

19 

314 

Ave( |d| ) 

168 

310 

43 

317 

Max(|d|) 

469 

510 

104 

475 

4-2 

2-2 

Ave(  d  ) 

-5 

-167 

-30 

72 

Ave(|d|) 

23 

167 

30 

78 

Hax(|d|) 

52 

309 

64 

135 

4"  3 

2-3 

Ave(  d  ) 

-11 

-57 

-16 

13 

• 

Ave(|d|) 

13 

74 

19 

23 

Max(|d() 

24 

134 

37 

47 

*The  computation  with  grid  spa.cing 

In  s  =  4"**, 

In  y  =  2“‘*  provides  the  baselii 

for  each  method. 

In  each  case,  the 

deviations 

suiTFiarIzed  are  d  =  (y^  -  y2)  x 

at  s  *  25(1)100»  where  y2  Is  the  approximation  at  baseline  and  Is  the 
approxlihatlon  at  the  grid  spacing  listed  (both  computed  by  the  same  method). 
For  this  range  of  S  values,  y  varies  between  -8  and  -21. 
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TABLE  10. 

DEVIATIONS  IN 

ESTIMATION  OF  BOUNDARY 

FOR  EXAMPLE  2.2. 

* 

Grid  Spacing 

Method 

y  s 

CA 

LA 

QA 

1  1 

Ave(  d  ) 

-196 

-1594 

-775 

Ave( |d|) 

494 

1594 

775 

Hax{ ld|) 

1441 

2414 

1716 

4*1  2-1 

Ave(  d  ) 

-167 

-698 

-323 

Ave( |d|) 

189 

698 

323 

Max( |dl) 

420 

987 

437 

4*2  2*2 

Ave(  d  ) 

-94 

-313 

-130 

Ave( |d|) 

99 

313 

130 

Max( |d|) 

183 

458 

186 

4-3  2-3 

Ave(  d  ) 

-41 

-144 

-57 

Ave( |d|) 

41 

144 

57 

Max( |d|) 

69 

221 

87 

4-"  2"' 

Ave(  d  ) 

-17 

-75 

-29 

Ave( |d|) 

17 

75 

29 

Max(|d|) 

30 

109 

42 

*In  each  case,  the  deviations  summarized  are  d  =  (y  -  y^j^)  x  lO'*  at  s  =  25(1)100 
where  y^j^  Is  the  approximation  obtained  using  method  EX  at  the  grid  spacing 
under  consideration.  For  this  range  of  s  values,  y  varies  between  -  8  and  -21. 
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TABLE  11.  DEVIATIONS  IN  ESTIMATION  OF  RISK  FOR  EXAMPLE  2.2.* 


Grid  Spacing 

s  y 

Ave(d) 

Ave(|d|) 

Max(|d|) 

1 

1 

1205 

1474 

8487 

4"! 

2‘1 

-22 

155 

420 

4“2  , 

2“  2 

-10 

39 

131 

4-3 

2' 3 

-3 

8 

20 

*In  each  case,  the  deviations  summarized  are  10^  times  the  differences  between 
the  optimal  risk  in  the  random  walk  problem  with  the  grid  spacing  listed  and 
that  with  grid  spacing  In  s  «  4'**,  In  y  =  2“**  at  all  grid  points  on  the 
Intersections  of  the  lines  s  =  25(1)100,  y  =  0(-l)~«  and  within  the  contin¬ 
uation  region  for  the  discrete  time  problem  with  the  less  refined  grid  spacing. 

Note  that  for  the  version  of  the  problem  being  considered  the  optimal  risk  Is 
always  negative  in  this  portion  of  the  continuation  region  and,  for  fixed  s, 
becomes  increasingly  negative  as  y  decreases  from  0;  In  this  portion  of  the 
continuation  region  the  risk  decreases  from  -1.7  to  -6.7  at  s  =  25  and  from 
-3.7  to  -20.8  at  s  =  100. 
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TABLE  12.  DEVIATIONS  IN  ESTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2.7.* 


Grid  Spacing 

t  X 

Method 

CA 

LA 

QA 

EX 

1(-2) 

1(-1) 

Ave(  d  ) 

-6501 

523 

188 

1984 

Ave(|d|) 

6501 

523 

188 

1984 

Hax(|d|) 

9688 

985 

579 

5910 

2-'(-1) 

Ave(  d  ) 

-830 

444 

160 

216 

Ave{|d|) 

843 

444 

160 

222 

Max( |d|) 

2188 

685 

245 

1050 

4-2(-2) 

2-2(-l) 

Ave{  d  ) 

-248 

204 

75 

56 

• 

Ave(|d|) 

256 

209 

76 

61 

Max(|d|) 

938 

375 

138 

297 

4'M-2) 

2'M-l) 

Ave(  d  ) 

-55 

74 

28 

11 

Ave(|d|) 

64 

91 

0 

33 

15 

Max(|d|) 

313 

168 

62 

64 

*The  computation  with  grid  spacing  In  t  =  4’**  x  10  in  x  =*  2  "^xlO”*  provides 
the  baseline  for  each  method  In  each  case,  the  deviations  sunmarized  are 
d  *  (x^  -  X2)  x 10^  at  t  “  0.04(0.01)0,75,  where  X2  is  the  approximation  at 
baseline  and  x^  Is  the  approximation  at  the  grid  spacing  listed  (both  computed 
by  the  same  method).  For  this  region  of  t  values,  x  varies  between  .16  and  .35. 
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TABLE  13.  DEVIATIONS  IN  ESTIMATION  OF  BOUNDARY  FOR  EXAMPLE  2.7. 


Grid  Spacing 

Method 

t  x 

CA 

LA 

QA 

l(-2)  K-l) 

Ave(  d  ) 

-8504 

-1400 

-1777 

Ave{|d|) 

8504 

1575 

1783 

Max(|d|) 

13006 

5410 

5504 

4’>(-2)  2'>(-1) 

Ave(  d  ) 

-1064 

289 

-36 

Ave(|d|) 

1064 

426 

196 

Max(|d|) 

2402 

866 

946 

4-2(.Z)  2-2(-i) 

Ave(  d  ) 

-322 

209 

38 

Ave(|d|) 

323 

229 

87 

Max{|d|) 

1042 

359 

254 

4-M-2)  2-3{-1) 

Ave(  d  ) 

-84 

124 

36 

Ave{|d|) 

85 

128 

44 

Hax(|d|) 

395 

197 

69 

4-4(.2) 

Ave{  d  ) 

-18 

61 

20 

Ave(|d|) 

20 

61 

21 

Max(|d|) 

80 

103 

38 

*In  each  case,  the 

deviations  summarized  are  d  =  (x  -  ^ 

10®  at 

t  -  0.04(0.01)0.75, 

where  X£jj  Is  the  approximation  obtained 

using  method  EX 

at  the  grid  spacing  under  consideration. 

For  this  range  of 

t  values. 

X  varies 

between  .16  and  .35. 
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TABLE  14.  DEVIATIONS  IN  ESTIMATION  OF  RISK  FOR  EXAMPLE  2,7.* 


Grid  Spacing 

t  X 

Ave(d) 

Ave( |d|) 

Max{|d|) 

1(-2) 

K-l) 

6133 

6133 

111700 

4-M-2) 

2-K-1) 

1378 

1378 

22643 

4-2{-2) 

2-K-i) 

338 

338 

7560 

4-3(-2) 

2-K-i) 

65 

65 

1006 

*In  each  case,  the  deviations  surrmarlzed  are  10^  times  the  differences  between 
the  optimal  risk  In  the  random  walk  problem  with  the  grid  spacing  listed  and 
that  with  grid  spacing  In  t  =  4’'*xl0'2,  in  x  -  2‘‘*xlO'^at  all  grid  points 
on  the  Intersections  of  the  lines  t  =  0.04(0.01)0.75,  x  =  0.0(0. 1)«  and 
within  the  continuation  region  for  the  discrete  time  problem  with  the  less 
refined  grid  spacing. 

Note  that  for  the  version  of  the  problem  being  considered,  the  optimal  risk 
Is  always  negative  In  this  portion  of  the  continuation  region  and,  for  fixed 
t,  becomes  Increasingly  negative  as  x  Increases  from  0;  In  this  portion 
of  the  continuation  region  the  risk  decreases  from  -.03  to  -.07  at  t  =  0.75, 
from  -.15  to  -.37  at  t  -  0.45,  and  from  -1.57  to  -2.67  at  t  =  0.04. 
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TABLE  15.  APPROXIMATION  TO  BOUNDARY  FOR  EXAMPLE  2.7. 


t 

i(t) 

t 

x(t) 

0.001 

0.027 

0.55 

0.341 

0.002 

0.038 

0.60 

0.333 

0.005 

0.059 

0.65 

0.321 

0.01 

0.082 

0.70 

0.306 

0.02 

0.114 

0.75 

0.287 

0.03 

0.138 

0.80 

0.263 

0.04 

0.157 

0.82 

0.252 

0.05 

0.174 

0.84 

0.240 

0.06 

0.188 

0.86 

0.226 

0.07 

0.201 

0.88 

0.211 

0.08 

0.213 

0.90 

0.194 

0.09 

0.223 

0.91 

0.185 

0.10 

0.233 

0.92 

0.175 

0.12 

0.250 

0.93 

0.165 

0.14 

0.265 

0.94 

0.153 

0.16 

0.277 

0.95 

0.140 

0.18 

0.289 

0.96 

0.126 

0.20 

0.298 

0.97 

0.109 

0.25 

0.318 

0.98 

0.090 

0.30 

0.332 

0.99 

0.064 

0.35 

0.341 

0.995 

0.045 

0.40 

0.346 

0.998 

0.028 

0.45 

0.348 

0.999 

0.020 

0.50 

0.346 

35 


TABLE  16.  ERRORS  IN  ESTIMATION  OF  RISK  FOR  MODIFIED  ANSCOMBE  PROBLEM 


s 

2  =  y/s*“ 

0 

1 

2 

3 

4 

10 

ER* 

-.6(-4) 

-.l(-3) 

RER** 

.2{-4) 

.3(-4) 

10^ 

£R 

-.5(-3) 

-.5(-3) 

-.2(-4) 

RER 

.6(-4) 

.4(-4) 

.l{-5) 

10^ 

ER 

-.2(-2) 

-.3(-2) 

.4(-4) 

.7(-4) 

RER 

.8(-4) 

.7(-4) 

-.6(-6) 

-.7{-6) 

10" 

ER 

-.4(-2) 

-.l(-2) 

.l(-2) 

.2(-3) 

RER 

.5(-4) 

.8(-5) 

-.5(-5) 

-.7(-6) 

105 

ER 

-.2{-1) 

-.8(-2) 

.3(-2) 

.9(-3) 

.2{-4) 

RER 

.6(-4) 

.2(-4) 

-.5(-5) 

-.1(-5) 

-.2(-7) 

10* 

ER 

-.2(-1) 

.5(-2) 

.l(-2) 

-.5{-5) 

RER 

.3(-4) 

.1(-4) 

-.3(-5) 

-.4(-6) 

.1(-8) 

♦ER  » 

Error  » 

Estimate  of 

risk  -  optimal 

risk 

**RER  »  Relative  error  »  Error/optimal  risk 
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TABLE  17.  ERRORS  IN  ESTIMATES  OF  BOUNDARY  FOR  MODIFIED  ANSCOMBE  PROBLEM 


‘Phase 

Last  s  value 

Ay 

Maximum  AER* 

Maximum  ARER** 

1 

1.052 

.005 

.00010 

.004 

.  2 

1.234 

.010 

.00025 

.004 

3 

1.962 

.020 

.00057 

.002 

4 

4.874 

.040 

.00124 

.001 

5 

16.522 

.080 

.00222 

.0008 

6 

63.114  . 

.160 

.00443 

.0004 

7 

249.482 

.320 

.00564 

.0003 

8 

994.954 

.640 

.01246 

.0003 

9 

% 

3,976.842 

1.280 

.05500 

.0005 

10 

15,904.394 

2.560 

.16643 

.0007 

11 

63,614.602 

5.120 

.50157 

.001 

12 

254,455.434 

10.240 

1.34060 

.001 

13 

1,017,818.762 

20.480 

3.29124 

.001 

*AER  *  Absolute  error  =  absolute  value  of  y  -  y 

^♦ARER  »  Absolute  relative  error  »  absolute  value  of  (y  y)/y 
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TABLE  18.  ESTIMATES  OF  STOPPING  BOUNDARY  FOR  SEQUENTIAL  ANALYSIS  PROBLEM 


t=l/s  x(s)=y(s)/s  'z{s)4(s)/s‘^  B(s)=l-t(2(s)) 


10.00 

9.50 
9.00 

8.50 

8.00 

7.50 
7.00 

6.50 

6.00 

5.50 
5.00 

4.50 
4.00 

3.50 
3.00 

2.50 

2.00 

1.50 
1.40 
1.30 
1.20 
1.15 
1.10 
1.05 
1.00 

.95 

.90 

.85 

.80 

.75 

.70 

.65 

.60 

.55 

.50 

.48 

145 

.44 

,42 

.40 

.38 

.36 

.34 

.32 

.30 


.02499 

.02630 

.02776 

.02939 

.03123 

.03331 

.03569 

.03843 

.04163 

.04541 

.04995 

.05550 

.06243 

.07130 

.08315 

.09961 

.1240 

.1636 

.1744 

.1865 

.2004 

.2080 

.2162 

.2250 

,2344 

.2451 

.2563 

.2679 

.2805 

,2940 

.3085 

.3240 

.3409 

.3590 

.3781 

.3862 

.3943 

.4026 

.4111 

.4198 

.4285 

.4373 

.4461 

.4550 

.4637 


.0079 

.0085 

.0093 

.0101 

.0110 

.0122 

.0135 

.0151 

.0170 

.0194 

.0223 

.0262 

.0312 

.0381 

.0480 

.0630 

.0877 

.1336 

.1474 

.1636 

.1830, 

.1940 

.2061 

.2196 

.2344 

.2515 

.2702 

.2906 

.3136 

.3395 

.3688 

.4019 

.4401 

.4840 

.5348 

.5574 

.5814 

.6069 

.6343 

.6637 

.6951 

.7288 

.7651 

.8042 

.8466 


.4968 

.4966 

.4963 

.4960 

.4956 

.4951 

.4946 

,4940 

.4932 

.4923 

.4911 

.4896 

.4875 

.4848 

.4809 

.4749 

.4651 

.4469 

.4414 

.4350 

.4274 

.4231 

.4184 

.4131 

.4073 

.4007 

.3935 

.3857 

.3769 

.3671 

.3561 

.3439 

.3299 

.3142 

.2964 

.2886 

.2805 

.2719 

.2629 

.2534 

.2435 

.2331 

.2221 

.2106 

.1986 
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TABLE  18.  (continued) 


t 

=  1/s  x{s)=y(s)/s 

z(s)=;(s)/s*« 

e(s)»i-*(z(s)) 

.28 

.4724 

.8928 

.I860 

.26 

.4809 

.9432 

.1728 

.24 

.4892 

.9986 

.1590 

.22 

.4969 

1.0595 

.1447 

.20 

.5038 

1.1264 

.1300 

.19 

.5069 

1.1629 

.1224 

.18 

.5097 

1.2013 

.1148 

.17 

.5121 

1.2421 

.1071 

.16 

.5144 

1.2859 

.09924 

.15 

.5159 

1.3319 

.09144 

.14 

.5170 

1.3818 

.08351 

.13 

.5175 

1.4352 

.07562 

.12 

.5170 

1.4926 

.06778 

.11 

.5158 

1.5552 

.05995 

.10 

.5134 

1.6234 

.05225 

.09 

.5096 

1.6985 

.04471 

.08 

.5039 

1.7816 

.03741 

.07 

.4961 

1.8751 

.03039 

.06 

.4855 

1.9819 

.02375 

.05 

.4707 

2.1052 

.01764 

.04 

.4507 

2.2534 

.01212 

.03 

.4222 

2.4376 

.007392 

.02 

.3797 

2.6848 

.003629 

.01 

.3074 

3.0738 

.001057 

91 

[-3: 

)  .2969 

3.1294 

.87591 

[-3) 

81 

Ml 

)  .2853 

3.1903 

.71071 

1-3) 

71 

[-3; 

1  .2726 

3.2583 

.56051 

M 

61 

Mi 

1  .2583 

3.3345 

.42731 

[-3) 

5( 

[-3] 

)  .2420 

3.4231 

.30961 

-3) 

4( 

)  .2231 

3.5276 

.20971 

[-3) 

'3 

1  .2004 

3.6581 

.12711 

[-3 

2i 

1-31 

1  .1714 

3.8329 

.63341 

1-4) 

11 

1-3 

1  .1300 

4.1118 

.19641 

9( 

1-4] 

1  *  .1246 

4.1518 

.16501 

1-4) 

I-'’ 

1  .1187 

4.1964 

.13571 

7| 

1-4] 

1  .1123 

4.2461 

.10881 

1-4) 

1-'*! 

1  .1054 

4.3028 

.8440i 

:-5) 

5i 

1-4) 

1  .09767 

4.3681 

.62711 

;-5) 

:-4 

1  .08895 

4.4473 

.43521 

1-5) 

3( 

,-4) 

1  .07874 

4.5462 

.27331 

1-5) 

2( 

-4) 

1  .06620 

4.6811 

.14281 

1-5) 

M 

:-4) 

1  .04902 

4.9020 

.47491 

;-6) 
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TABLE  18.  (continued) 


t  ^ 

=  1/s  x(s)=y(s)/s 

zCsj'yCsl/s** 

.  e(s)»l-4.(z(s)) 

9{-5; 

1  .04681 

4.9346 

.40211 

[-6) 

81 

)  .04446 

4.9709 

.33371 

-6 

71 

[-5 

1  .04193 

5.0113 

.27071 

i-6) 

61 

1  .03918 

5.0578 

.2124( 

[-6) 

51 

[-5] 

\  .03614 

5.1113 

.16021 

:-6) 

41 

-5 

1  .03274 

5.1773 

.11281 

I -6) 

31 

1-5] 

1  .02881 

5.2603 

.7204( 

1-7 

21 

[-5 

1  .02403 

5.3742 

.38541 

-7) 

11 

-5 

\  .01759 

5.5638 

.1323 

9| 

1-6 

1  .01678 

5.5917 

.1127( 

-7) 

81 

:-6 

1  .01590 

5.6227 

.9428 

-8 

7( 

:-6i 

1  .01497 

5.6581 

.7675( 

-8) 

6( 

1-® 

>  .01396 

5.6986 

6056 

-8 

5( 

1-6] 

1  .01285 

5.7457 

4590( 

-8) 

1-® 

1  .01161 

5.8031 

.3266 

-8 

31 

1-6] 

1  .01018 

5.8759 

.2110 

-8 

2 

M 

1  .008453 

5.9770 

.1140(-8) 

li 

1-6] 

1  .006146 

6.1456 

.3999( 

-9) 

TABLE  19.  ESTIMATES  OP  BAYES  RISK  FOR  SEQUENTIAL  ANALYSIS  PROBLEM* 


‘o  ■  ’/'o 

*0  ■ 

0 

0.5 

1.0 

1  .5 

2.0 

3.0 

4.0 

5.0 

5.00 

.1759 

2.00 

.2667 

1 .00 

.3414 

.50 

.3876 

.20 

.3765 

.3183 

•  1828 

.10 

.3322 

.2910 

.1934 

.9099(-l ) 

•05 

.2775 

.2468 

.1734 

«9498(-1 ) 

.3737(-1  ) 

.02 

.2072 

.1856 

•  1338 

.7816(-1) 

.3705(-1 ) 

.01 

•  1614 

•  1447 

•  1048 

.6201 (-1 ) 

.3052(-1 ) 

.3763(-2) 

5(-3) 

.1234 

•  1106 

.8001 (-1 ) 

.4730(-1) 

.2343(-1 ) 

.3697(-2) 

2(-3) 

•846a(-1 ) 

.7576(-l). 

.5447(-1 ) 

.3187(-1 ) 

.1559(-1 ) 

.2642(-2) 

1(-3) 

.6284<-1) 

.561  K-i) 

.4011(-1) 

.2321(^1) 

.1117(-1 ) 

.1858(-2) 

.2094 (-3) 

5<-4) 

.4619(-1 ) 

.4118(-1 ) 

•2926(-1 ) 

.1674(-1 ) 

.7902 (-2) 

.1253(-2) 

.1833(-3; 

2(-4) 

•3040(-1) 

•2704(-1) 

.1907(-1) 

.1076(-1) 

.4954(-2> 

.7210(-3) 

.n67(-3) 

1(-4) 

.2199(-1) 

.1953(-1) 

.1371(-1) 

.7660 (-2) 

.3466(-2} 

.4698(-3) 

.7563 (-4) 

5<-5) 

.1583(-1) 

.1405(-1 ) 

.9819(-2) 

•5441 (-2) 

.2425(-2) 

.3056(-3) 

.4697 (-4) 

.6465 (-5) 

2(-5) 

.1020(-1 ) 

.9032(-2) 

.6286(-2) 

•3451 (-2) 

.15l2(-2) 

.1743(-3) 

.2409 (-4) 

.4874(-5) 

1(-5) 

.7283(-2) 

.6446 (-2) 

.4475(-2) 

.2444(-2] 

.1060(-2) 

.n49(-3) 

.1429(-4) 

.3309(-5) 

5<-6) 

.5191 (-2) 

.4591 (-2) 

,3180(-2) 

.1729(-2) 

.7432(-3) 

-7639(-4) 

.8430(-5) 

.2092(-5) 

2(-6) 

•3308(-2) 

.2924(-2) 

.2021 (-2) 

.1094(-2) 

.4660(-3) 

.45l7(-4) 

.4185(-5) 

.1071 (-5) 

1(-6) 

.2349(-2) 

.2075(-2) 

.1432(-2) 

.7733(-3) 

.3278(-3) 

.3066(-4) 

.2480(-5} 

.6247(-6) 

•The  quantity 

tabulated 

is  BR  «  Bayes 

.  ^^2/3  1/3 
rxsKA  c 

-  E(d(Y(S),sj}  -  s"'  . 

TABLE  20 

.  ESTIMATES  OP  BAYES  EXPECTED  COST  OP  SAMPLING  FOR  SEQUENTIAL  ANALYSIS  PROBLEM* 

*0  ■ 

0 

'o  ■  '/»o 

0 

0.5 

1 .0 

1  .5 

2.0 

3.0 

4.0 

5.0 

5.00 

.2501 (-2) 

2.00 

.1457(-1  ) 

1  oOO 

.4931 (-1 ) 

.50 

.1079 

.20 

.1575 

.1166 

.2389(-1 ) 

.10 

.1606 

.1345 

.7380(-1) 

.1243(-1 ) 

.05 

.1459 

.1275 

.3386(->1  ) 

.3a04(*1 ) 

.4990 (-2) 

.02 

.1166 

•  1040 

.7382(-1 ) 

.4141 (-1 ) 

.1738(-1) 

.01 

.9410(-1 ) 

.3437(-1 ) 

.6101 (-1 ) 

.35a3(-1 ) 

.1710(-1 ) 

.5592(-3) 

5(-3) 

.7391 (-1 ) 

.6636(-1 ) 

.4d24(-1 ) 

.2873(-1 ) 

.M29(-1  ) 

.1805(-2) 

2(-3) 

.5209(-1 ) 

.4673(-1 ) 

.33a8(-1 ) 

<.2013(-1  ) 

.1007(-1 ) 

.1698(-2) 

1  (-3) 

.3927{-1 ) 

.3517(-1 ) 

.2537(-1  ) 

.1494(-1 ) 

.73a4(-2) 

.1293(^2) 

.5924(-4) 

5(-4) 

.2925(-1 ) 

.2614(-1 ) 

.ia74(-1 ) 

.1090(-1 ) 

.5293 (-2) 

.9086(-3) 

.1063(-3) 

2(-4) 

.1951 <-1 ) 

.1739(-1 ) 

.1236(-1 ) 

.7081 (-2) 

.3347(-2) 

.535a(-3) 

.a427(-4) 

1(-4) 

.1423(-1  ) 

.1266{-1) 

.a949(-2) 

.S066(-2} 

.2347(^2) 

.3509(-3) 

.5855{-4) 

5{-5) 

.1031(-1) 

.9163(-2) 

.6442(-2) 

.3610(-2) 

.1642(-2) 

.2278(-3) 

.3787 (-4) 

.2344(-5) 

2(.5) 

.6685(-2) 

.5929(-2) 

.4144(-2) 

.2295(-2) 

.1022(-2) 

.1286(-3) 

.2000 (-4) 

.3204(-5) 

1(«5) 

.4793(-2) 

.4246(->2) 

.295a(-2) 

.1627(-2) 

.7151(-3) 

.8390 (-4) 

.1200(-4) 

.2469(-5) 

5(-6) 

.3426(-.2) 

.3033(-2) 

.2l06(-2) 

.1152(-2) 

.5006(-3) 

.55l2(-4) 

.7l06(-5) 

.1669<-5) 

2(-6) 

.2190(-2) 

.1937(-2) 

.1341 (-2) 

.7291 (-3) 

.3132(.3) 

.3208(-4) 

.3St8(-5) 

.8997 (-6) 

1(-6) 

.l55Q(-2) 

.1377(-2) 

.95l8(-3) 

.5l55(-3) 

.2200(-3) 

.2l53(-4) 

.2068(-5) 

.5382(-6) 

*The  quantity  tabulated  is  ECS  »  Bayes  expected  cost  of  sampling/X^^^c^'^^o^^^  »  E(S*^)  -  s*^ 

0 
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TABLE  21.  ESTIMATES  OF  STOPPING  BOUNDARY  FOR  ONE-ARMED  BANDIT  PROBLEM 


t  -  1/s 


x(s)=y(s)/s  z(s)=y(s)/s^  b(s)=*(2(s)) 


.9995 

.999 

.995 

.99 

.98 

.97 

.96 

.95 

.94 

.93 

.92 

.91 

.90 

.88 

.86 

.84 

.82 

.80 

.78 

.76 

.74 

.72 

.70 

.68 

.66 

.64 

.62 

.60 

.58 

.56 

.54 

.52 

.50 

.48 

.46 

.44 

.42 

.40 

.38 

.36 

.34 

.32 

.30 

.28 

.26 

.24 

.22 

.20 


-.01430 

-.02026 

-.04524 

-.06391 

-.09022 

-.1103 

-.1272 

-.1420 

-.1554 

-.1675 

-.1789 

-.1894 

-.1993 

-.2177 

-.2344 

-.2498 

-.2640 

-.2775 

-.2900 

-.3017 

-.3129 

-.3234 

-.3333 

-.3428 

-.3517 

-.3602 

-.3683 

-.3760 

-.3832 

-.3901 

-.3965 

-.4026 

-.4086 

-.4138 

-.4187 

-.4231 

-.4272 

-.4309 

-.4340 

-.4367 

-.4388 

-.4405 

-.4415 

-.4419 

-.4416 

-.4404 

-.4383 

-.4354 


-.0143 

-.0203 

-.0454 

-.0642 

-.0911 

-.1120 

-.1298 

-.1456 

-.1603 

-.1737 

-.1865 

-.1986 

-.2101 

-.2321 

-.2528 

-.2725 

-.2915 

-.3103 

-.3284 

-.3461 

-.3637 

-.3811 

-.3984 

-.4157 

-.4329 

-.4503 

-.4678 

-.4854 

-.5032 

-.5212 

-.5396 

-.5583 

-.5778 

-.5973 

-.6173 

-.6379 

-.6592 

-.6813 

-.7041 

-.7278 

-.7525 

-.7787 

-.8061 

-.8351 

-.8660 

-.8990 

-.9345 

-.9736 


.4943 

.4919 

.4819 

.4744 

.4637 

.4554 

.4484 

.4421 

.4363 

.4310 

.4260 

.4213 

.4168 

.4082 

.4002 

.3926 

.3853 

.3782 

.3713 

.3646 

.3580 

.3516 

.3452 

.3388 

.3325 

.3262 

.3200 

.3137 

.3074 

.3011 

.2947 

.2883 

.2817 

.2752 

.2685 

.2618 

.2549 

.2479 

.2407 

.2334 

.2259 

.2181 

.2101 

.2018 

.1932 

.1843 

.1750 

.1651 
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TABLE  21.  (continued) 


t  * 

'  1/s  x(s)=y(s)/s 

z(s)=y(s)/s’^ 

B(s)=4>(z(s 

.18  -.4311 

-1.0160 

.1548 

.16 

-.4252 

-1.0630 

.1439 

.14 

-.4176 

-1.1161 

.1322 

.12 

-.4076 

-1.1767 

.1197 

.10 

-.3946 

-1.2477 

.1061 

.09 

-.3866 

-1.2886 

.09877 

.08 

-.3773 

-1.3340 

.09110 

.07 

-.3665 

-1.3854 

.08296 

.06 

-.3540 

-1.4450 

.07423  • 

.05 

-.3387 

-1.5146 

.06494 

.04 

-.3198 

-1.5988 

.05493 

.03 

-.2956 

-1.7069 

.04392 

.02 

-.2626 

-1.8569 

.03166 

.01 

-.2108  - 

-2.1081 

.01751 

9 

(-3 

)  -.2035 

-2.1454 

.01596 

8 

-3 

)  -.1956 

-2.1868 

.01438 

7' 

-3 

)  -.1869 

-2.2336 

.01275 

6 

i 

)  -.1772 

-2.2871 

.01109 

5 

(-3 

)  -.1662 

-2.3500 

.009388 

4 

-3 

)  -.1534 

-2.4258 

.007638 

3 

-3 

-.1381 

-2.5222 

.005832 

2 

-3 

-.1188 

-2.6554 

.003961 

1 

-3 

)  -.09090 

-2.8744 

.002024 

9 

-4 

'  -.08720 

-2.9067 

.001826 

8 

-4' 

1  -.08321 

-2.9420 

.001630 

7 

-4: 

1  -.07892 

-2.9829 

.001428 

6 

-4' 

-.07420 

-3.0293 

.001226 

5 

-4, 

'  -.06895 

-3.0836 

.001023 

4 

-4; 

1  -.06297 

-3.1487 

.8201(-3) 

3 

*4: 

t  -.05597 

-3.2316 

.61551 

-3) 

2i 

ii 

1  -.04730 

-3.3445 

.41221 

-3) 

1 ' 

*4, 

'  -.03533 

-3.5327 

.20571 

1-3) 

9i 

;-5 

t  -.03378 

-3.5605 

.18511 

1-3) 

8 

-5' 

'  -.03213 

-3.5917 

.16431 

'-3) 

7 

-5 

-.03034 

-3.6263 

.14381 

1-3) 

6i 

-5 

-.02838 

-3.6640 

.12421 

-3) 

5( 

'-5’ 

i  -.02625 

-3.7116 

.10301 

-3) 

1  -.02383 

-3.7680 

.82301 

-4) 

3( 

-5 

1  -.02103 

-3.8397 

.61621 

1-4) 

-5 

1  -.01762 

-3.9388 

.40951 

-4) 

1| 

-5 

1  -.01297 

-4.1013 

.20551 

:-4) 

9( 

:’6i 

1  -.01238 

-4.1257 

.18491 

[-4) 

? 

i 

1  -.01175 

-4.1532 

.16401 

(-4) 

7( 

>  -.01107 

-4.1839 

.14341 

(-4) 

-6 

1  -.01033 

-4.2190 

.12281 

!-4) 

5( 

1  -.009526 

-4.2602 

.10221 

(-4) 

4( 

-6 

'  -.008620  . 

-4.3101 

.81631 

-5) 

3( 

-6 

i  -.007570 

-4.3706 

.62001 

[-5) 

2( 

'6: 

'  -.006307 

-4.4597 

.41071 

[-5) 

K 

-6) 

'  -.004608 

-4.6077 

.20381 

1-5) 

TABLE  22.  ESTIMATES  OP  BAYES  EXPECTED  PAYOFF  FOR  ONE-ARMED  BANDIT  PROBLEM* 


'o  ■  V.Q 

0 

-0.5 

-1.0 

.50 

..1774 

.0035 

•  20 

.1059(1 ) 

.2390 

.10 

.2769(1) 

.8971 

.0839 

.05 

.6420(1  ) 

.2479(1 ) 

.5175 

.02 

.1784(2) 

.7773(1) 

.2375(1) 

.01 

.3728(2) 

.1708(2) 

.5961(1) 

5(-3) 

•7658(2) 

•3618(2) 

.1362(2) 

2(-3) 

.1953(3) 

.9447(2) 

.3758(2) 

1(-3) 

.3940(3) 

.1925(3) 

.7838(2) 

5(-4) 

.7920(3) 

.3892(3) 

.1607(3) 

2(-4) 

.1987(4) 

.9812(3) 

.4093(3) 

1(-4) 

.3981(4) 

.1969(4) 

.8245(3) 

5(-5) 

.7969(4) 

•3946(4) 

.1657(4) 

2(-5) 

.1994(5) 

.9878(4) 

.4154(4} 

1(-5) 

•3988(5) 

.1977(5) 

.8319(4) 

5(-6) 

.7977(5) 

.3955(5) 

.1665(5) 

2(-6) 

.1995(6) 

.9890(5) 

.4165(5) 

1(-6) 

.3989(6) 

.1978(6) 

.8330(5) 

•1  .5 


-2.0 


-3.0 


-4.0 


.3003 

.1249 

.0268 

.3592(1) 

.3915 

.1150(2) 

.2219(1 ) 

.2538(2) 

.5867(1 ) 

.5387(2) 

.1370(2) 

.0233 

.1406(3) 

.3824(2) 

.6137 

.2861(3) 

.7992(2) 

.2089(1 ) 

.5783(3) 

.1640(3) 

.5440(1) 

.1456(4) 

.4176(3) 

.1628(2) 

.2920(4) 

.8409(3) 

.3482(2) 

.0493 

.5850(4} 

.1689(4) 

.7247(2) 

.4370 

.1464(5) 

.4232(4) 

.1860(3) 

.2117( 

.2929(5) 

.8477(4) 

.3765(3) 

.5354  ( 

’(T(S),S) }  - 

d-(yo..o>]- 

•The  quantity  tabulated  ia  BEP 


Bayes  expected  payoff/ 


TABLE  23.  ESTIMATES  OP  BATES  E3CPECTID  SAMPLE  SIZE  FOR  ONE-ARMED  BANDIT  PROBLEM* 


.50 
•  20 
.10 
.05 
.02 
.01 
5(-3> 
2(.3) 
1(-3) 
5(-4) 
2(-4) 

1  (-4) 
5(-5) 
2(-5) 
1(-5) 
5(-6) 
2(.6) 
l(-6) 


0 

-0.5 

-1  .0 

-1 .5 

.5786 

.0835 

.2217(1) 

.1047(1 ) 

.4851(1) 

.2637(1 ) 

.7097 

.1001 (2) 

.5782(1) 

.2256(1 ) 

.2528(2) 

.1513(2) 

.6942(1 ) 

.1884(1 ) 

.5052(2) 

.3064(2} 

.1480(2) 

.5065(1  ) 

.1008(3) 

.6157(2) 

«3055(2) 

.1154(2) 

.2512(3) 

.1542(3) 

.7795(2) 

.3125(2) 

.5016(3) 

d3086(3) 

.1571(3) 

•6434(2) 

.1002(4) 

.6172(3) 

.3155(3) 

.1308(3) 

.2502(4) 

.1543(4} 

.7913(3) 

.3308(3) 

.5003(4) 

.3086(4) 

.1584(4) 

.6643(3) 

.1000(5) 

.6172(4) 

.3171 (4) 

.1332(4) 

.2501 (5) 

.1543(5) 

.7931 (4) 

.3336(4) 

.5001(5) 

.3086(5) 

.1586(5) 

.6677(4) 

.1000(6) 

.6171 (5) 

.3173(5) 

.1336(5) 

.2500(6) 

.1543(6) 

.7935(5) 

.3340(5) 

.5000(6) 

.3086(6) 

.1587(6) 

.6681 (5) 

-2.0 


.5210 
.2588(1 ) 
.9084(1  ) 
.2018(2) 
.4257(2) 
.1103(3) 
.2236(3) 
.4507(3) 
.1132(4) 
.2270(4) 
•4544(4) 
.1137(5) 
.2274(5) 


-3.0 


-4.0 


.5929 

.4387(1 ) 

.1094(2) 

.2417(2) 

.6433(2} 

1314(3) 

.1032 

(1) 

2659(3) 

.4101 

(1) 

6696(3) 

•  1334 

(2) 

1344(4) 

.2907 

(2) 

•Th«  quantity  tabulate  is  EN  -  Baysa  expected  sanpie  aize/a^c'^ 


3o[e(s- 


-1 


]. 


t  ^ 
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TABLE  24. 

STOPPING  BOUNDARIES 

?^(t)  FOR  ANSCOHBE'S 

PROBLEH  WITH 

ETHICAL  COST* 

t 

Y»0.0 

Y^^tm 

Y»i  .0 

Y-10.0 

1(-6) 

1.03(~6) 

1.13(~6) 

2.05(-6) 

1.12(-5) 

2(-6) 

2.05(-6) 

2.25(~6) 

4.10(-6) 

2.25(-5) 

3(-6) 

3.07(-6) 

3.38(-6) 

6.13(>6) 

3.37(-5) 

4(-6) 

4.09(-6) 

4.50(-6) 

8.17(~6) 

4.50(-5) 

5(-6) 

5.11(-6) 

5.62(-6) 

1.02(-5) 

5-63(-5) 

6(-6) 

6.14(-6) 

6.75(-6) 

1.23(-5) 

6.76(-5) 

7(-6) 

7.15(-6) 

7,87(-6) 

1.43(-5) 

7.88(-5) 

8(-6) 

8.17(>6) 

8.98(-6) 

1 .64(>5) 

9.02(-5) 

9(-6) 

9.20(-6) 

1.01(-5) 

t.84(>5) 

1.01(>4) 

l(-5) 

1 .02(-5) 

1-12(-5) 

2.05(-5) 

1.13(-4) 

2(-5) 

2.04(-5) 

2.25(-5) 

4.09(-5) 

2.26(-4) 

3(-5) 

3.07(-5) 

3.38(-5) 

6.l5(-'5) 

3.39(-4) 

4(-5) 

4.09(~5) 

4.50(-5) 

8.20(-5) 

4,53(-4) 

5(-5) 

5.12(-5) 

5.65{-5) 

1.03(-4) 

5.65(-4) 

6(-5) 

6.l6(-5) 

6.78(-5) 

1.23(-4) 

6.79(-4) 

7(-5) 

7.20(~5) 

7.91(-5) 

1.44(-4) 

7.92(-4) 

8(-5) 

8.22(-5) 

9.04(-5) 

1.65(-4) 

9.05(-4) 

9(-5) 

9.25(-5) 

1 .02(-4) 

1.65(-4) 

0.00102 

1(“4) 

1.03(-4) 

1.13(-4) 

2.06(-4) 

0.00113 

2(-4) 

2.07(-4) 

2.27(-4) 

4.13(-4) 

0.00223 

3(-4) 

3.11(-4) 

3.42(>4) 

6.21(>4) 

0.00332 

4(-4) 

4.16(-4) 

4.56(>4) 

6.2B(>4) 

0.00437 

5(-4) 

5.20(-4) 

5.71(-4) 

0.00103 

0.00540 

6(-4) 

6.25(-4) 

6.86(-4) 

0.00124 

0.00642 

7(-4) 

7.28(-4) 

B.01(-4) 

0.00144 

0.00741 

8(-4) 

8;34(-4) 

9.15(-*4) 

0.00165 

0.00839 

9(-4) 

9.39(-4) 

0.00103 

0.00185 

0.00935 

0.001 

0.00104 

0.00114 

0.00206 

0.0103 

0.002 

0.00208 

0.00228 

0.00405 

0.0191 

0.003 

0.00311 

0,00340 

0.00599 

0.0269 

0.004 

0.00412 

0.00451 

0.00786 

0.0340 

0.005 

0.00513 

0.00561 

0.00969 

0.0405 

0.006 

0.00612 

0.00668 

0.0115 

0.0466 

0.007 

0.00710 

0.00775 

0.0132 

0.0523 

0.008 

0.00807 

0.00680 

0.0149 

0.0576 

10.009 

0.00903 

0.00984 

0.0166 

0.0626 

0.01 

0.00998 

0.0109 

0.0182 

0.0674 

0.02 

0.0190 

0.0206 

0.0332 

0.1060 

0.03 

0.0274 

0.0295 

0.0462 

0.1339 

0.04 

0.0353 

0.0378 

0.0578 

0.1560 

0.05 

0.0427 

0.0457 

0.0684 

0.1741 

0.06 

0.0498 

0.0531 

0.0783 

0.1896 

0.07 

0.0566 

0.0602 

0.0876 

0.2034 

0.06 

0.0631 

0.0670 

0.0962 

0.2153 

0.09 

0.0694 

0.0736 

0.1043 

0.2260 

0.10 

0.0754 

0.0799 

0.1120 

0.2357 

0.11 

0.0813 

0.0660 

0.1193 

0.2445 

0.12 

0.0870 

0.0918 

0.1263 

0.2525 

0.13 

0.0926 

0.0976 

0.1330 

0.2600 

0.14 

0.0980 

0.1032 

0.1394 

0.2669 

0.15 

0.1033 

0.1085 

0.1456 

0.2735 

*t  «  currently  available  proportion  of  total  potential  Information 
«  noadnal  significance  level 
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TABLE  24  (continued) 


0.16 
0.17 
0.16 
0.19 
0.20 
0.22 
0.24 
0.26 
0.28 
0.30 
0.32 
0.34 
0.36 
0.38 
0.40 
0.42 
0.44 
0.46 
0.46 
0.50 
0.52 
0.54 
0.56 
0.56 
0.60 
0.62 
0.64 
0.66 
0.68 
0.70 
0.72 
0.74 
0.76 
0.78 
0.60 
0.82 
0.64 
0.86 
0.66 
0.90 
0.92 
0.94 
0.95 
0.96 
0.97 
0.98 
0.99 
0.995 
0.999 
0.9995 
1 .0000 


Y»0.0 


0.1085 

0.1135 

0.1164 

0.1233 

0.1280 

0.1374 

0.1463 

0.1550 

0.1635 

0.1718 

0.1798 

0.1877 

0.1955 

0.2031 

0.2106 

0.2180 

0.2253 

0.2325 

0.2397 

0.2468 

0.2540 

0.2610 

0.2680 

0.2751 

0.2621 

0.2891 

0.2961 

0.3032 

0.3104 

0.3176 

0.3249 

0.3324 

0.3399 

0.3477 

0.3556 

0.3639 

0.3725 

0.3814 

0.3908 

0.4009 

0.4116 

0.4241 

0.4309 

0.4383 

0.4467 

0.4566 

0.4694 

0.4784 

0.4904 

0.4932 

0.5000 


Y-0.1 


0.1138 

0.1190 

0.1240 

0.1290 

0.1339 

0.1434 

0.1525 

0.1612 

0.1698 

0.1781 

0.1862 

0.1941 

0.2019 

0.2095 

0.2170 

0.2243 

0.2316 

0.2388 

0.2459 

0.2529 

0.2601 

0.2670 

0.2740 

0.2809 

0.2878 

0.2947 

0.3016 

0.3086 

0.3156 

0.3227 

0.3298 

0.3371 

0.3445 

0.3521 

0.3599 

0.3680 

0.3763 

0.3849 

0.3941 

0.4039 

0.4145 

0.4264 

0.4330 

0.4403 

0.4484 

0.4580 

0.4704 

0.4791 

0.4907 

0.4935 

0.5000 


Y-1  .0 


0.15J5 

0^1573 

0.1629 

0.1683 

0.1736 

0.1839 

0.1935 

0.2026 

0.2114 

0.2198 

0.2279 

0.2358 

0.2434 

0.2508 

0,2579 

0.2650 

0.2718 

0.2786 

0.2852 

0.2917 

0.2962 

0.3045 

0.3108 

0.3170 

0.3231 

0.3292 

0.3353 

0.3414 

0.3475 

0,3536 

0.3598 

0.3660 

0.3723 

0.3787 

0.3853 

0.3921 

0.3990 

0.4063 

0.4139 

0.4219 

0.4307 

0.4403 

0.4456 

0.4517 

0.4583 

0.4660 

0.4761 

0.4831 

0.4924 

0.4947 

0.5000 


Y-IO.O 


0.2795 

0.2852 

0.2906 

0.2958 

0.:^006 

0.3100 

0.3183 

0.3259 

0.3330 

0.3396 

0.3458 

0.3516 

0.3571 

0.3623 

0.3672 

0.3720 

0.3765 

0.3809 

0,3852 

0.3893 

0.3934 

0.3974 

0.4012 

0.4049 

0.4065 

0.4120 

0.4155 

0.4190 

0.4224 

0.4258 

0.4291 

0.4325 

0.4359 

0.4393 

0.4428 

0.4463 

0.4500 

0.4537 

0.4576 

0.4617 

0.4660 

0.4708 

0.4735 

0.4765 

0.4797 

0.4835 

0.4684 

0.4918 

0.4963 

0.4975 

0.5000 


TABLg  25 . 


JAYES  PROPERTIES  OP  OPTIMAL  PROCmURES  IN  msC0MBE‘S  PROBLEM  WTTH  gTHICAI.  msT 


1(-1) 

0.0 

1.78(.61) 

1.76 

0«1 

1 .83<.60) 

1.69 

1«0 

2.16(.53) 

1o29 

10.0 

3.54( .34) 

.47 

5(-2) 

0.0 

2.55(.63) 

2.91 

0.1 

2.63(.63) 

2.80 

1.0 

3.20(.S6) 

2.15 

10.0 

5.S1(.40) 

.82 

2(-2> 

0.0 

3.80(.S6) 

5.31 

0.1 

3.94(.66} 

5.11 

1.0 

4.99(.60) 

3.93 

10.0 

10.20(.46) 

1.57 

1(-2) 

0.0 

4.95(.68) 

8.11 

0.1 

5.15(.68) 

-7.80 

1  .0 

6.70(.63) 

6,01 

10.0 

14.d2(.5l ) 

2.46 

5(-3) 

0.0 

6.31(.70) 

12.19 

0.1 

6.59(.70) 

11.73 

1.0 

8.77(.65) 

9.05 

10.0 

20.a2(.S4) 

3.76 

2(-3) 

0.0 

8.45<.72) 

20.53 

0.1 

a.86(.72) 

19.76 

1  .0 

12.12(.68) 

15.27 

10.0 

31.21(.59) 

6.45 

1.62(.57) 

1.43 

1.66(.56) 

1,37 

1.99(.49) 

.99 

3.18(.24) 

•  23 

- 

2.34(.61 } 

2.47 

2.42( .60) 

2.36 

2.99(.54) 

1.76 

5.45(.35) 

•  54 

3.52(.65) 

4.61 

2.78(.62) 

2.96 

3.65<,65) 

4.42 

2.89(.61) 

2.82 

4.69(.60) 

3.35 

3.76<.55) 

2.01 

9.77(.45) 

1.21 

7.25(.29) 

.41 

4.60(,68) 

7.11 

3.68(.66} 

4.75 

4.80(.67) 

6.83 

3.85{ .65) 

4.54 

6.31 (.63) 

5.21 

5.16(.60) 

3.34 

14.27(.50) 

2.01 

11  .42(.42) 

.98 

5»87(.70) 

10.75 

4.73(,69) 

7.34 

6.14(.69) 

10.34 

4.97(,68) 

7,04 

8,27(.65) 

7.92 

6.82(.64) 

5.28 

20.06(.S4) 

3.18 

16.65( .50) 

1.82 

7.86(.72) 

18,17 

6,35(,72) 

12.59 

8.25(.72) 

17.48 

6.70( .71 ) 

12.09 

11.41(.6a) 

13.47 

9,46(.68) 

9.21 

30.00( .59) 

5.58 

25.45(.58) 

3.55 

"  proportion  of  total  information  in  prior 

BR  «  Bayes  risJt/o^g”! 

0 

PR  -  proportion  of  Bayes  risk  due  to  the 
experimental  phase 

EH  -  Bayes  expected  sample  size/o^^-Z 


3.30(.65) 

3.80 

3.48( .64) 

3.62 

4.80(.59) 

2.56 

10,33(.31) 

.49 

4.51 ( ,70) 

6.79 

2.81 ( .65) 

2.77 

4.78( .70) 

6.50 

2.98(.64) 

2.63 

6,84(.66) 

4.81 

4.19(.58) 

1  ,79 

17.69( .50) 

1.49 

8.35(.13) 

.13 

CD 


TABLE  25  (continued) 


0*5_ KO_ K5_ 2,0 


^0 

Y 

BR  (PR) 

£N 

BR  (PR) 

EH 

BR  (PR) 

EN 

BR  ( PR ) 

£N 

BR  (PR) 

EN 

BR  (PR) 

EN 

1(-3) 

0.0 

10,34(.74) 

30.15 

9. 61 (.74) 

26.72 

7.77(.74) 

18.61 

5,55(.73) 

10,18 

3.54( ,70) 

4.34 

0.1 

10.88(.73) 

29,03 

10.13(.73) 

25.72 

a.22(.73) 

17.90 

5.89(.73) 

9.77 

3,76( .69) 

4.14 

1  .0 

15.17(.70) 

22.47 

14.26(.70) 

19.87 

11,80(.70) 

13.72 

8.60(.69) 

7,37 

5.49(,65) 

2.98 

10.0 

41.25(.62) 

9,59 

39.54(.62) 

8,38 

33.69(.62) 

5.54 

24,39( .58) 

2.64 

13.66(.41} 

.69 

5(-4) 

0.0 

12.50(.75) 

44,00 

11.60(.75) 

39,01 

9.3fe(.76) 

27.21 

6,6a(.75) 

14.98 

4.32(.74) 

6.51 

0.1 

13.19<.75) 

42.37 

12.16(.75) 

37^56 

9.92(.75) 

26.19 

7.12(  .75) 

14,40 

4,61 ( .73) 

6.24 

1  .0 

18  •  71  ( .  72 ) 

32.85 

l7o55(.72) 

29.08 

14.47(.73) 

20.20 

10.5a(  .72) 

11.00 

6.90(.70) 

4.65 

10.0 

53.42( .64) 

14,15 

51 .03( .65) 

12o44 

43.46( .65) 

8.41 

32.12( .63) 

4.29 

19.63(.54) 

1.48 

2(-4) 

0,0 

15.77{.77) 

71 .90 

14.61 ( .77) 

63,74 

11 .73( ,78) 

44,47 

8,35(.7a) 

24.51 

5,44( c77) 

10,74 

0,1 

16.69(.77) 

69.26 

15.49(.77) 

61  .40 

12.47{ .77) 

42.83 

a,92( .77) 

23.59 

5.a3( .77) 

10,33 

1 .0 

24.17(.74) 

53.81 

22.60(,74) 

47,68 

18,53( .75) 

33,21 

13.51(.75) 

18.22 

8.93(,74) 

7.90 

10.0 

73.13(.68) 

23.43 

69.51 (.68) 

20,69 

58.a9( ,69) 

14.23 

44.00(.68) 

7,58 

28.52(.64) 

3,02 

1  (-4) 

0.0 

18.57( ,78) 

103.73 

l7ol9( .78) 

91  .92 

13,74(.79) 

64.05 

9,74( .79) 

35,24 

6.35(,79) 

15.43 

0.1 

19.71{.78) 

99.95 

18,26(,78) 

88.57 

14.64( ,79) 

61  .72 

10,42(.79) 

33.95 

6.ai{.79) 

14.86 

1  .0 

28.94(.76) 

77,78 

27,00(,76) 

68.91 

22.01 ( .77) 

47,99 

15,98( .77) 

26.36 

10.60( .77) 

11  .49 

10,0 

91.05(.70) 

34.11 

86o22(.70) 

30.17 

72.62( .71 ) 

20.89 

54.30(  ,71  ) 

11.30 

36.00( .69) 

4.72 

5(-5) 

0.0 

21 .67(.79) 

149.08 

20. 02(. 80)132. 05 

15.93(,80) 

91  .88 

11 .24(.81) 

50.41 

7.31(.81) 

21  .99 

2.67( .75) 

2.25 

0,1 

23.05( .79) 

143.68 

21  . 31  (. 79)127, 27 

17.01 ( .80) 

88.56 

12.04(.80) 

48.59 

7.86( ,81 ) 

21  .19 

2.86( .74) 

2.16 

1  .0 

34.28( .77) 

111.98 

31  ,90(,77) 

99.19 

25.d6( .78) 

69.03 

18.66(.79) 

37.88 

12.38(.79) 

16.51 

4.38( ,70) 

1 .61 

10.0 

111 ,73( .72) 

49.44 

105.42(.72) 

43.77 

88.18(.73) 

30.40 

65.74(.74) 

16.58 

44.09(.73) 

7.10 

12.11(.45) 

.42 

TABLg  25  (continued) 


Oj^O 

T  BR  (PR)  EN 


2(-5) 

0.0 

26.24(.81) 

239.73 

0.1 

27.97(.80) 

231.10 

1  .0 

42.25(.79) 

180*44 

10.0 

143. 62( .74} 

o 

* 

o 

00 

1(-5) 

0.0 

30.06(.82) 

342.35 

0.1 

32. 09 (.81 ) 

330.09 

1  .0 

48.98( .80) 

258.05 

10.0 

171.31(.75) 

115.45 

5(-6) 

0.0 

34.19(.83) 

487.99 

0.1 

3&.56(.82) 

470.57 

1  .0 

56.33(.81) 

368.27 

10.0 

202.24(.77) 

165.53 

2(-6) 

o 

* 

o 

40.15(.84) 

777.63 

0.1 

43. OK. 83) 

749.99 

1  .0 

67.02(.82) 

587.63 

10.0 

248.20(.79) 

265.49 

1  (-6) 

0.0 

45. 03(. 84)1104. 72 

0.1 

48. 31(, 84)1065. 57 

1  .0 

75.86(.83) 

635.48 

10.0 

286.93(.e0) 

378.69 

0.5 

BR  (PR)  EN 


z 


0 


1 .0> 

BR  (PR)  EN 


1  .5 

BR  (PR)  EN 


24.19(«81)212.20 
25.81 (.81)204.57 
39. 20(. 79)159. 75 
134.90(.74)  71.11 

27. 66(. 82)302. 87 
29. 56(. 82)292. 03 
45. 34(. 80)228*34 
160.38(.76)  99.65 

31 .41 (.83)431 .54 
33.62( .82)416.15 
52.04(.81 )325.75 
188. 77(. 77)146. 52 

36.81 (.84)687.32 
39. 47(. 84)662. 91 
61 .75( .82)519.50 
230. 80(. 79)234.89 

41.23(. 84)976. 11 
44.26( .84)941 .53 
69. 77(. 83)738. 36 
266. 13(. 80)334. 91 


19. 13(. 81)147. 31 
20. 46( *81)142.02 
31  .53( .80)110.97 
111.75(.75)  49.44 

21. 78(. 82)209. 94 
23. 33(. 82)202. 44 
36.25(. 81)158. 40 
131.87(.77)  71.05 

24. 62(. 83)298. 64 
26. 40(. 83)288. 02 
41  .37(. 82)225.61 
154. 06(. 78)101. 73 

28.68( .84)474.90 
30.81 (.84)458.08 
48. 74(. 83)359. 21 
ie6.59(.60)162.e3 

31. 98(. 85)673. 67 
34.39( .85)649.86 
54. 78(. 84)509. 92 
213. 69( .81  )231  .84 


13.38(.82)  80.45 
14.36(.82)  77.58 
22.54(.ei)  60.68 
82.67(.76)  27.07 

15.13(. 83)114.31 
16.26( .83)110.25 
25.72(.82)  86.38 
96*83(.78}  38.89 

16. 98(. 84)162. 10 
18.27( .84)156.36 
29.13(.83)122.66 
112.19(.80)  55.57 

19. 61(. 85)256. 91 
21.13(.85)247.86 
33.96( .84)194.62 
134.32(.81)  88.68 

21 *72(. 86)363.63 
23. 42(. 86)350. 83 
37. 87(. 85)275. 62 
152. 46( .82)125.92 


2.0 

BR  (PR)  EN 


8. 

.66( 

.83) 

34 

.84 

9, 

.32( 

•  83) 

33, 

.61 

14 

.89( 

•  81) 

26 

.33 

55, 

.75( 

.76) 

11 

.72 

9. 

.74( 

.84) 

49, 

.22 

10. 

.50( 

•84) 

47, 

.49 

16, 

.90  ( 

•  83) 

37, 

.30 

65, 

.25( 

•  78} 

16. 

.87 

10, 

.86( 

.85} 

69. 

.41 

11, 

.73( 

•  85) 

66, 

.98 

19, 

.02( 

.84) 

52. 

.66 

75, 

.34( 

•80) 

24, 

.06 

12, 

.43( 

.86)109, 

.29 

13, 

.44( 

•86)105, 

,47 

21  , 

.97( 

.85) 

83, 

.03 

89. 

.52( 

.82) 

38, 

,19 

13, 

,67( 

.87)154, 

.07 

14, 

.79( 

•87)148, 

,70 

24, 

.31  ( 

.86)117. 

.09 

100, 

,92( 

.83) 

53. 

,99 

3.0 

BR  (PR) 


3.30(.79)  3.55 
3.55(.79)  3.43 
5.61(.76)  2.66 
18.40(.62)  1.01 

3.78(.81)  4.93 
4.08(.81)  4.76 
6.56(.79)  3.75 
23*32(.69)  1.60 

4.27(.83)  6.77 
4.62(.83)  6.55 
7.53(.81)  S.20 
2B.37{.74)  2.37 

4.94(.85)10.31 
5.35(.85)  9.97 
8.83(.84)  7.95 
35.20(.79)  3.78 

5.44(. 86)14. 18 
5.91 (.86)13.71 
9. 83(  ,85)10.94 
40.49(.81)  5.27 
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TABLE  27,  DIFFERENCES  IN  TWO  VERSIONS  FOR  ANSCOMBE’S  PROBLEM  WITH  ETHICAL 
COSTi  CASE  Y  -  1 • 
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Fig.  6. 


Bayes  Expected  Cost  of  Sampling  for  Sequential  Analysis  Problem 
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rig.  14.  Bayes  Ejq^ected  Sample  Sizes  for  Oner Armed  Bandit  Problem 
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